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Why  GAO  Did  This  Study 

In  fiscal  year  201 7,  the  federal 
government  is  expected  to  spend  more 
than  $89  billion  on  IT.  In  many 
instances,  agencies  have  not 
consistently  applied  best  practices  that 
are  critical  to  successfully  acquiring  IT 
investments,  such  as  ensuring 
program  staff  have  the  necessary 
knowledge  and  skills.  In  an  effort  to  aid 
agencies  in  successfully  delivering 
projects,  the  Office  of  Management 
and  Budget  has  called  for  the 
development  and  use  of  IPTs  for 
federal  IT  acquisitions  to  ensure  that 
projects  consist  of  the  appropriate  mix 
of  individuals.  GAO  was  asked  to 
review  IPTs  for  federal  IT  acquisitions 
and  the  federal  government’s  IT 
workforce  planning. 

GAO’s  objectives  were  to  (1 )  identity 
key  characteristics  of  comprehensive 
IPTs  responsible  for  managing  major 
federal  IT  acquisitions,  and  (2) 
evaluate  whether  selected  federal 
agencies  are  adequately  assessing 
and  addressing  gaps  in  knowledge  and 
skills  that  are  critical  to  the  success  of 
major  IT  acquisitions.  To  do  so,  GAO 
reviewed  relevant  literature; 
interviewed  IPT  experts;  and  evaluated 
IT  workforce  efforts  at  five 
departments:  Commerce,  Defense, 
Health  and  Human  Services, 
Transportation,  and  the  Treasury. 

What  GAO  Recommends 

GAO  recommends  that  selected 
departments  implement  IT  workforce 
planning  practices  to  facilitate  more 
rigorous  analyses  of  gaps  between 
current  skills  and  future  needs,  and  the 
development  of  strategies  for  filling  the 
gaps.  Four  departments  agreed  and 
one,  Defense,  partially  agreed  with  our 
recommendations. 

View  GAO-17-8.  For  more  information,  contact 
David  Powner,  202-512-9286, 
pownerd@gao.gov. 


What  GAO  Found 


Integrated  program  teams  (IPT)  are  cross-functional  or  multidisciplinary  groups 
of  individuals  that  are  organized  and  collectively  responsible  for  delivering  a 
product  to  an  external  or  internal  customer.  GAO  identified  three  characteristics 
that  contribute  to  the  creation  and  operation  of  a  comprehensive  IPT:  (1) 
executive  leadership  through  team  support,  empowerment,  and  oversight;  (2) 
team  composition;  and  (3)  processes  for  team  operations.  GAO  also  identified  18 
practices  supporting  these  three  characteristics  (see  figure).  For  example, 
executive  leadership  is  effective  when  sufficient  resources  are  provided  and 
teams  are  empowered  to  act,  team  composition  is  more  robust  when  the  IPT  has 
cross-functional  and  multidisciplinary  skill  sets,  and  team  operations  are 
streamlined  when  team  guidelines  are  established  and  stakeholders  are  involved 
as  active  members.  When  implemented,  these  practices  can  increase  the  IPTs 
likelihood  of  success  by  having  the  right  mix  of  expertise  to  recognize  problems 
early  and  by  having  the  requisite  authority  to  do  something  about  them. 


Figure:  Key  Characteristics  and  Practices  of  Comprehensive  Integrated  Program  Teams  (IPT) 
for  Major  Information  Technology  Acquisitions 
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Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the 
Software  Engineering  Institute;  and  data  from  selected  agency  chief  information  officers  and  program  offices  from  the  Departments  of 
Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 


While  multiple  factors  contribute  to  a  robust  IPT,  one  aspect  involves  having  a 
strong  information  technology  (IT)  workforce.  To  evaluate  agencies’  IT  workforce 
planning  efforts,  GAO  identified  eight  key  workforce  planning  steps  and  activities 
based  on  relevant  laws  and  guidance  (see  table). 
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Table:  Summary  of  Key  Information  Technology  (IT)  Workforce  Planning  Steps  and  Activities 

Set  the  strategic  direction  for  IT  workforce  planning 

Activity  1 :  Establish  and  maintain  a  w  orkforce  planning  process 

Activity  2:  Develop  competency  and  staffing  requirements 

Analyze  the  IT  workforce  to  identify  skill  gaps _ 

Activity  3:  Assess  competency  and  staffing  needs  regularly _ 

Activity  4:  Assess  gaps  in  competencies  and  staffing 

Develop  strategies  and  implement  activities  to  address  IT  skill  gaps 

Activity  5:  Develop  strategies  and  plans  to  address  gaps  in  competencies  and  staffing _ 

Activity  6:  Implement  activities  that  address  gaps  (including  IT  acquisition  cadres,  cross-functional 
training  of  acquisition  and  program  personnel,  career  paths  for  program  managers,  plans  to 
strengthen  program  management,  and  use  of  special  hiring  authorities) 

Monitor  and  report  progress  in  addressing  IT  skill  gaps 

Activity  7:  Monitor  the  agency’s  progress  in  addressing  competency  and  staffing  gaps 
Activity  8:  Report  to  agency  leadership  on  progress  in  addressing  competency  and  staffing  gaps 

Source:  GAO  analysis  of  relevant  laws  and  guidance.  |  GAO-17-8 

Five  federal  departments  had  mixed  progress  in  assessing  their  IT  skill  gaps. 
While  all  five  departments  had  demonstrated  important  progress  in  either  partially 
or  fully  implementing  key  IT  workforce  planning  activities,  each  had  shortfalls.  For 
example,  four  departments  had  not  demonstrated  an  established  IT  workforce 
planning  process. 

Figure:Selected  Departments’  Implementation  of  Bght  Key  Information  Technology 
Workforce  Planning  Activities 

Total  number  of  activities 


5 

1 

1 - 

1 

1 

ln 

1 

L  _ 

1 - 

1 

1 

lN 

1 

L  _ 

3 

7 

6 

5 

7 

Department  of  Department  of  Department  of  Department  of  Department  of 
Commerce  Defense  Health  and  Transportation  the  Treasury 

Human  Services 

Agencies 


Number  of  activities  fully  implemented  |  |  Number  of  activities  not  implemented 
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Source:  GAO  analysis  of  departments’ data.  |  GAO-17-8 

As  shown  in  the  figure,  of  the  five  departments,  the  Department  of  Defense  had 
the  most  robust  IT  workforce  planning  process  by  fully  or  partially  implementing 
all  eight  activities.  Flowever,  the  departments  have  not  yet  fully  implemented  all 
of  the  practices  for  \arious  reasons.  For  example,  policies  were  not 
comprehensive  in  requiring  such  activities  or  were  not  being  applied  to  IT 
workforce  planning  at  four  departments,  one  department  placed  a  greater 
emphasis  on  assessing  its  cybersecurity  workforce,  and  two  departments 
identified  the  need  to  perform  more  granular  assessments  of  the  workforce  in 
order  to  identify  skill  gaps.  Until  the  departments  fully  implement  key  workforce 
planning  steps  and  activities,  they  risk  not  adequately  assessing  and  addressing 
gaps  in  knowledge  and  skills  that  are  critical  to  the  success  of  major  acquisitions. 
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GAO 

441  G  St.  N.W. 
Washington,  DC  20548 


U.S.  GOVERNMENT  ACCOUNTABILITY  OFFICE 


November  30,  2016 

The  Honorable  Ron  Johnson 
Chairman 

Committee  on  Homeland  Security  and  Governmental  Affairs 
United  States  Senate 

The  Honorable  Jason  Chaffetz 
Chairman 

Committee  on  Oversight  and  Government  Reform 
House  of  Representatives 

In  fiscal  year  2017,  the  federal  government  is  expected  to  spend  more 
than  $89  billion  on  information  technology  (IT).  Unfortunately,  projects  too 
frequently  fail  or  incur  cost  overruns  and  schedule  slippages  while 
contributing  little  to  mission-related  outcomes.  We  have  previously 
reported  that  failed  IT  projects  often  suffered  from  a  lack  of  disciplined 
and  effective  management,  such  as  project  planning,  requirements 
definition,  and  program  oversight  and  governance.1  In  many  instances, 
agencies  had  not  consistently  applied  best  practices  that  are  critical  to 
successfully  acquiring  IT  investments,  such  as  ensuring  program  staff 
have  the  necessary  knowledge  and  skills.  As  a  result,  we  added 
“Improving  the  Management  of  Information  Technology  Acquisitions  and 
Operations”  to  our  high  risk  list  in  February  201 5. 2 

In  an  effort  to  aid  agencies  in  successfully  delivering  IT  projects,  the 
Office  of  Management  and  Budget  (OMB)  has  called  for  the  development 
and  use  of  integrated  program  teams  (IPT)  for  federal  IT  acquisitions  to 
ensure  that  projects  consist  of  the  appropriate  mix  of  individuals.3  OMB 
defines  an  IPT  as  a  cross-functional  or  multidisciplinary  group  of 
individuals  that  are  organized  and  collectively  responsible  for  the  specific 
purpose  of  delivering  a  product  to  an  external  or  internal  customer.  IPTs 
include  a  program  manager,  other  key  experts,  and  stakeholders. 


1GAO,  High-Risk  Series: An  Update,  GAO-1 5-290  (Washington,  D.C.:  Feb.  1 1 , 2015). 

2GAO-1 5-290. 

3OMB,  25  Point  Implementation  Plan  to  Reform  Federal  Information  Technology 
Management,  Dec.  9,  2010. 
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Part  of  having  a  sound  IPT  is  ensuring  an  agency  has  a  workforce  that 
contains  the  appropriate  mix  of  skills  and  number  of  staff  that  possess 
those  skills.  Law  and  guidance  over  the  past  20  years  has  called  for 
federal  agencies  to  assess  IT  knowledge  and  skill  requirements,  identify 
gaps  in  meeting  those  requirements,  and  develop  strategies  and  plans  to 
address  deficiencies.4 

Accordingly,  you  asked  us  to  review  IPTs  and  the  federal  government’s  IT 
workforce  planning.  Specifically,  our  objectives  were  to  (1)  identify  key 
characteristics  of  a  comprehensive  IPT  responsible  for  managing  a  major 
federal  IT  acquisition,  and  (2)  evaluate  whether  selected  federal  agencies 
are  adequately  assessing  and  addressing  gaps  in  knowledge  and  skills 
that  are  critical  to  the  success  of  major  IT  acquisitions. 

To  address  our  first  objective,  we  reviewed  practices  applicable  to  IPTs 
that  were  recommended  by  leading  government  and  industry 
organizations  such  as  OMB,  the  Project  Management  Institute,  Inc., 
MITRE  Corporation,  and  GAO;  reviewed  practices  recommended  by 
officials  from  two  federal  agency  IPTs  for  major  IT  acquisitions,  the  offices 
of  the  chief  information  officer  (CIO)  with  responsibilities  for  those  IPTs, 
the  Department  of  Defense  (Defense)  Office  of  the  CIO,  and  two 
agencies’  acquisition  centers  of  excellence;  performed  a  content  analysis 
on  recommended  IPT  practices  to  identify  key  characteristics;  and 
validated  the  results  of  our  analysis  with  the  selected  organizations  and 
internal  experts. 

To  address  our  second  objective,  we  reviewed  relevant  laws  and 
guidance  to  federal  agencies  and  created  an  evaluation  framework  of  IT 
workforce  planning  practices  that  were  consistent  with  strategic  human 
capital  planning  practices  recommended  by  the  Office  of  Personnel 
Management  (OPM),  OMB,  and  GAO.  We  selected  five  departments — 
Commerce,  Defense,  Health  and  Human  Services,  Transportation,  and 
the  Treasury — based  on  the  following  factors:  (1)  largest  number  of  major 
IT  investments,  (2)  largest  planned  dollar  total  of  major  IT  spending  in 
fiscal  year  2016,  and  (3)  largest  planned  percentage  of  total  major  IT 
spending  with  development,  modernization,  and  enhancements  in  fiscal 
year  2016.  We  analyzed  the  extent  to  which  departments  were 
implementing  the  set  of  practices  from  our  IT  workforce  planning 


4For  example,  Clinger-Cohen  Act  of  1996,  Pub.  L.  No.  1 04-1 06,  §  51 25(c)(3)  (Feb.  10, 
1996),  codified  at  40  U.S.C.  §  1 1315(c)(3). 
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framework  and  interviewed  cognizant  officials  at  the  selected 
departments. 

We  conducted  this  performance  audit  from  July  2015  to  November  2016 
in  accordance  with  generally  accepted  government  auditing  standards. 
Those  standards  require  that  we  plan  and  perform  the  audit  to  obtain 
sufficient,  appropriate  evidence  to  provide  a  reasonable  basis  for  our 
findings  and  conclusions  based  on  our  audit  objectives.  We  believe  that 
the  evidence  obtained  provides  a  reasonable  basis  for  our  findings  and 
conclusions  based  on  our  audit  objectives.  See  appendix  I  for  a  more 
detailed  discussion  of  our  objectives,  scope,  and  methodology. 


Background 


IPTs  are  to  bring  together  the  different  areas  of  expertise  needed  to 

acquire  a  new  product,  such  as  engineering,  manufacturing,  purchasing, 
and  finance.* * * * 5  The  essence  of  the  IPT  approach  is  to  concentrate  this 
expertise  in  a  single  team  together  with  the  authority  to  design,  develop, 
test,  manufacture,  and  deliver  a  product.  The  hallmark  of  these  teams  is 
their  ability  to  efficiently  make  decisions  that  cross  lines  of  expertise. 

Over  the  last  two  decades,  the  federal  government  has  taken  steps  to 
improve  IT  acquisitions  through  the  use  of  IPTs.  Building  on  success  from 
private  industry’s  use  of  IPTs,  Defense  adopted  them  in  an  attempt  to 
improve  its  weapon  system  acquisitions.  In  1996,  the  department 
published  a  guide  on  integrated  product  and  process  development  based 
on  its  survey  of  policies  and  practices  for  over  80  government  and 
industry  organizations.6  Defense’s  intention  was  to  use  the  teams  in  the 
same  manner  as  commercial  firms — to  integrate  different  functional 
disciplines  into  a  team  responsible  for  all  aspects  of  an  acquisition. 

Recognizing  IPTs’  potential  to  improve  the  federal  government’s 
approach  to  managing  IT  investments,  OMB  has  called  for  the 
development  and  use  of  IPTs  for  federal  IT  acquisitions.  In  2010,  OMB 
published  a  25-point  action  plan  that  was  intended  to  address  many  of  the 


5Our  research  found  that  there  are  manyterms  used  to  describe  the  conceptof  such 
teams  to  include:  integrated  program  team,  integrated  project  team,  integrated  product 
team,  program  managementoffice,  project  managementoffice,  cross-functional  team,  and 
multidisciplinary  team.  For  the  purposes  of  this  report,  we  adopted  terminology  that  has 
been  used  by  OMB — integrated  program  teams. 

6DOD  Guide  to  Integrated  Product  and  Process  Development  (Vers  ion  1 .0),  February  5, 
1996. 


Page  3 


GAO-17-8  IT  Workforce 


most  pressing,  persistent  challenges  to  the  federal  government’s 
management  of  IT.7  One  of  the  actions  OMB  cited  was  to  require  that 
IPTs  were  in  place  before  OMB  approves  program  budgets.  Additional 
actions  agencies  are  to  take  are  to  dedicate  resources  to  the  team 
throughout  the  program  lifecycle  and  hold  team  members  accountable  for 
individual  goals  and  overall  program  success. 

Subsequently,  OMB  has  incorporated  revisions  to  its  Capital 
Programming  Guide  and  related  guidance,  which  require  the  use  of  IPTs 
prior  to  OMB’s  approval  of  an  investment’s  business  case.8  Specifically, 
OMB  requires  that  each  major  IT  investment  establish  an  IPT  that 
includes,  at  a  minimum,  a  fully  dedicated  program  manager,  a  contracting 
specialist  (if  applicable),  an  IT  specialist,  an  IT  security  specialist,  and  a 
business  process  owner  or  subject  matter  expert. 


7OMB,  25  Point  Implementation  Plan  to  Reform  Federal  Information  Technology 
Management,  Dec.  9,  2010. 

8OMB,  Circular  No.  A-1 1:  Preparation,  Submission,  and  Execution  ofthe  Budget, 
Supplementto  Part  7,  Capital  Programming  Guide  (June  201 5)  and  FY17  IT  Budget- 
Capital  Planning  Guidance  (June  22, 201 5),  accessed  at 

https://www.whitehouse.gov/omb/e-gov/strategiesandguideson  September27, 201 6. 
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IT  Workforce  Planning  Is 
Needed  to  Support 
Effective  I  PTs 


Effective  IT  workforce  planning  is  key  to  an  agency’s  success  in 
developing  IPTs  with  the  necessary  knowledge,  skills,  and  abilities  to 
execute  a  range  of  management  functions  that  support  the  agency’s 
mission  and  goals.9  Over  the  past  20  years,  various  laws  were  enacted 
and  guidance  issued  that  call  for  agencies  to  perform  workforce  planning 
activities  that  ensure  the  timely  and  effective  acquisition  of  IT.  These  laws 
and  guidance  focus  on  the  importance  of  (1)  setting  the  strategic  direction 
for  workforce  planning,  (2)  analyzing  the  workforce  to  identify  skill  gaps, 
(3)  developing  strategies  to  address  skill  gaps,  and  (4)  monitoring  and 
reporting  on  progress  in  addressing  skill  gaps.  For  example: 

•  The  Clinger-Cohen  Act  of  1996  requires  agency  CIOs  to  annually  (1 ) 
assess  the  requirements  established  for  agency  personnel  regarding 
knowledge  and  skill  in  information  resource  management  and  the 
adequacy  of  such  requirements  for  facilitating  the  achievement  of 
performance  goals;  (2)  assess  the  extent  to  which  the  positions  and 
personnel  at  executive  and  management  levels  meet  those 
requirements;  (3)  develop  strategies  and  specific  plans  for  hiring, 
training,  and  professional  development  to  address  any  deficiencies; 
and  (4)  report  to  the  head  of  the  agency  on  the  progress  made  in 
improving  information  resources  management  capability.10 


9GAO,  A  Model  of  Strategic  Human  Capital  Management,  GAO-02-373SP  (Washington, 
D.C.:  Mar.  15,2002 ),  Human  Capital:  Key  Principles  for  Effective  Strategic  Workforce 
Planning, GAO-04-39  (Washington,  D.C.:  Dec.  1 1 , 2003);  Information  Technology: FDA 
Needsto  Establish  Key  Plans  and  Processes  for  Guiding  Systems  Modernization  Efforts, 
GAO-09-523  (Washington,  D.C.:  June  2,  2009);  Information  Technology:  Critical  Factors 
Underlying  Successful  Major  Acquisitions,  GAO-1 2-7  (Washington,  D.C.:  Oct.  21 , 201 1 ); 
Cyb  ersecurity  Hum  an  Capital:  Initiatives  Need  BetterPlanning  and  Coordination, 
GAO-12-8  (Washington,  D.C.:  Nov.  29,  201 1 ); Information  Technology: SSA Needsto 
Address  Limitations  in  ManagementControlsand  Human  Capital  Planning  to  Support 
Modernization  Efforts,  GAO-14-308  (Washington,  D.C.:  May  8,  2014); 
Telecommunications:  GSA  Needs  to  Share  and  Prioritize  Lessons  Learned  to  Avoid 
Future  Transition  Delays,  GAO-14-63  (Washington,  D.C.:  Dec.  5,  2013);  2020  Census: 
Key  Challenges  Need  to  Be  Addressed  to  Successfully  Enable  Internet  Response, 
GAO-15-225  (Washington,  D.C.:  Feb.  5,2015);  Federal  Emergency  Management  Agency: 
Additional  Planning  and  Data  Collection  Could  Help  Improve  Workforce  Management 
Efforts,  GAO-15-437  (Washington,  D.C.:  July  9,  201 5);  2020  Census: Key  Information 
Technology  Decisions  Must  Be  Made  Soon,  GAO-1 6-205T  (Washington,  D.C.:  Nov.  3, 
2015);  Information  Technology: FEMA  Needsto  Address ManagementWeaknessesto 
Improve  Its  Systems,  GAO-16-306  (Washington,  D.C.:  Apr.  5,  2016);  and  VA  IT 
Management:  Organization  Is  Largely  Centralized;  Additional  Actions  Could  Improve 
Human  Capital  Practices  and  Systems  Development  Processes,  GAO-1 6-403 
(Washington,  D.C.:  Aug.  17,2016). 

10Pub.  L.  No.  104-106,  §  5125(c)(3)(Feb.  10,  1 996),  codified  at  40  U.S.C.  §  11315(c)(3). 


Page  5 


GAO-17-8  IT  Workforce 


•  The  E-Government  Act  of  2002  requires  the  Director  of  OPM,  in 
consultation  with  the  Director  of  OMB,  the  Chief  Information  Officers 
Council,  and  the  Administrator  of  General  Services  to  (1)  analyze,  on 
an  on-going  basis,  the  personnel  needs  of  the  federal  government 
related  to  IT  and  information  resource  management;  and  (2)  identify 
where  current  IT  and  information  resource  management  training  does 
not  satisfy  personnel  needs.  In  addition,  the  law  requires  the  Director 
of  OMB  to  ensure  that  agency  heads  collect  and  maintain 
standardized  information  on  their  IT  and  information  resources 
management  workforce.11 

•  In  2010,  OMB  issued  its  25-point  plan  for  IT  reform  and  outlined 
several  action  plans  to  build  workforce  capabilities,  including 
acquisition  and  program  management.12  For  example,  OMB  stated 
that  OPM  will  work  with  OMB  to  provide  agencies  with  direct  hiring 
authority  for  program  managers  and  directed  OPM  to  create  a 
specialized  career  path.  OMB  also  tasked  agencies  with  identifying 
program  management  competency  gaps  and  reporting  on  those  gaps. 

•  Subsequent  to  the  25-point  plan,  in  July  201 1 ,  OMB  released 
guidance  for  agencies  to  develop  specialized  IT  acquisition  cadres.13 
Among  other  things,  this  memorandum  required  agencies  to  analyze 
current  acquisition  staffing  challenges;  determine  if  developing  or 
expanding  the  use  of  cadres  would  improve  program  results;  and 
outline  a  plan  to  pilot  or  expand  cadres  for  an  especially  high-risk 
area,  if  the  agency  determined  that  such  an  effort  would  improve 
performance. 

•  Further,  in  November  201 1  OPM  issued  guidance  for  developing 
career  paths  for  IT  program  managers.14  OPM’s  career  path  guide 
was  to  build  upon  its  IT  Program  Management  Competency  Model 
released  in  July  201 1  by  serving  as  a  roadmap  for  individuals 
interested  in  pursuing  a  career  in  this  area  and  providing  employees 
and  their  supervisors  with  a  single-source  reference  to  determine 
appropriate  training  opportunities  for  career  advancement. 


■"Pub.  L.  No.  107-347,  §  209  (Dec.  17,  2002), 44  U.S.C.  §  3501  note. 

12OMB,  25  Point  Implementation  Plan  to  Reform  Federal  Information  Technology 
Management(\Nash\ngton,  D.C.:  Dec.  9,  2010). 

13OMB,  Guidance  for  Specialized  Information  Technology  Acquisition  Cadres 
(Washington,  D.C.:  July  13,  2011). 

14OPM,  IT  Program  Management  Career  Path  Guide,  Nov.  1 8, 201 1 . 
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•  In  December2014,  Congress  enacted  legislation  commonly  referred 
to  as  the  Federal  Information  Technology  Acquisition  Reform  Act 
(FITARA).15  Among  other  things,  the  law  aims  to  ensure  timely 
progress  by  federal  agencies  toward  developing,  strengthening,  and 
deploying  IT  acquisition  cadres  consisting  of  personnel  with  highly 
specialized  skills  in  IT  acquisition,  including  program  and  project 
managers.  Agencies  (other  than  Defense)  are  required  to  update  their 
acquisition  human  capital  plans  to  address  how  they  are  meeting  their 
human  capital  requirements  to  support  timely  and  effective 
acquisitions. 

•  To  assist  agencies  in  implementing  the  provisions  of  FITARA  and  to 
reinforce  provisions  of  the  Clinger-Cohen  Act  of  1996,  OMB  issued 
guidance  to  agencies  in  June  2015. 16  In  doing  so,  OMB  directed 
agencies  (other  than  Defense)  to,  among  other  things,  (1)  develop  a 
set  of  competency  requirements  for  staff,  including  leadership 
positions;  and  (2)  develop  and  maintain  a  current  workforce  planning 
process  to  ensure  the  agency  can  (a)  anticipate  and  respond  to 
changing  mission  requirements,  (b)  maintain  workforce  skills  in  a 
rapidly  developing  environment,  and  (c)  recruit  and  retain  the  talent 
needed  to  accomplish  the  mission.  Each  agency  is  to  conduct  an 
annual  self-assessment  of  its  conformity  with  these  requirements  and 
develop  an  implementation  plan  describing  the  changes  it  will  make. 

•  In  October  2015,  OMB  required  agencies  to  identify  their  top  five 
cybersecurity  talent  gaps  by  December  201 5  as  a  one-time  effort.17 
Specifically,  agencies  were  to  participate  in  an  OPM  cybersecurity 
staffing  exercise  to  identify  the  universe  of  their  cyber  talent, 
understand  challenges  for  retaining  talent,  and  address  gaps 
accordingly. 

•  The  Federal  Cybersecurity  Workforce  Assessment  Act  of  201 5 
required  OPM,  with  support  from  the  National  Institute  of  Standards 
and  Technology,  to  establish  a  coding  structure  to  be  used  in 
identifying  all  federal  civilian  and  non-civilian  positions  that  require  the 


15Carf  Levin  and  Howard  P.  “Buck”McKeon  National  Defense  Authorization  Actfor  Fiscal 
Year  201 5,  Div.  A,  Title  VIII,  Subtitle  D — Federal  Information  Technology  Acquisition 
Reform,  Pub.  L.  No.  11 3-291,  §  835  (Dec.  19,  2014),  41  U.S.C.  §  1704  note. 

16OMB,  Managementand  Oversight  of  Federal  Information  Technology,  Memorandum 
M-15-14  (Washington,  D.C.:  June  10,  2015). 

17OMB,  Cybersecurity  Strategy  and  Implementation  Plan  (CSIP)  for  the  Federal  Civilian 
Government,  Memorandum  M-16-04  (Washington,  D.C.:Oct.  30,  2015). 


Page  7 


GAO-17-8  IT  Workforce 


performance  of  IT,  cybersecurity,  or  other  cyber-related  functions.18 
Agencies,  in  consultation  with  OPM,  the  National  Institute  of 
Standards  and  Technology,  and  the  Department  of  Homeland 
Security,  were  then  required  to  utilize  this  coding  structure  to  annually 
assess,  among  other  things,  the  IT,  cybersecurity,  and  other  cyber- 
related  work  roles  of  critical  need  in  the  agency’s  workforce.  We  have 
additional  planned  work  in  this  area. 

•  OMB  released  its  Federal  Cybersecurity  Workforce  Strategy  in  July 
201 6. 19  Among  other  things,  the  strategy  cited  the  need  for  agencies 
to  examine  specific  IT,  cybersecurity,  and  cyber-related  work  roles, 
and  identify  personnel  skills  gaps,  rather  than  merely  examining  the 
number  of  vacancies  by  job  series.  The  strategy  identified  several 
actions  that  agencies  could  take  to  identify  workforce  needs,  expand 
the  cybersecurity  workforce  through  education  and  training,  recruit 
and  hire  highly  skilled  talent,  and  retain  and  develop  highly  skilled 
talent. 

•  Finally,  in  July  2016  OMB  issued  updated  policy  for  the  planning, 
budgeting,  governance,  acquisition,  and  management  of  federal 
information,  personnel,  equipment,  funds,  IT  resources  and 
supporting  infrastructure  and  services.20  Among  other  things,  OMB’s 
updated  circular  requires  the  agency’s  chief  human  capital  officer, 
CIO,  chief  acquisition  officer,  and  senior  agency  official  for  privacy  to 
develop  a  set  of  competency  requirements  for  staff  and  develop  and 
maintain  a  current  workforce  planning  process. 

While  the  laws  and  guidance  focus  on  IT  workforce,  there  are  also  other 
broader  initiatives  to  improve  federal  human  capital  management.  For 
example,  we  and  OPM  developed  human  capital  management  models 
that  call  for  implementing  workforce  planning  practices  that  can  facilitate 
the  analysis  of  gaps  between  current  skills  and  future  needs  and  the 
development  of  strategies  for  filling  the  gaps,  as  well  as  planning  for 


^Federal  Cybersecurity  Workforce  Assessment  Actof  201 5,  Pub.  L.  No.  114-113,  Div.  N, 
Title  III  (Dec.  18,2015). 

19OMB,  Federal  Cybersecurity  Workforce  Strategy,  Memorandum  M-1 6-1 5  (Washington, 
D.C.:  July  12,  2016). 

20OMB,  Circular  A-1 30,  Managing  Information  as  a  Strategic  Resource  (Washington,  D.C.: 
July  27,  2016). 
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succession.21  In  addition,  our  Standards  for  Internal  Control  in  the  Federal 
Government  stress  that  management  should  consider  how  best  to  retain 
valuable  employees,  plan  for  their  eventual  succession,  and  ensure 
continuity  of  needed  skills  and  abilities.22 


GAO  Has  Previously  We  have  previously  reported  on  commercial  and  Defense  teaming 

Reported  on  Federal  IPTs  practices  and  found  that  IPTs  can  develop  and  deliver  superior  products 
and  IT  Workforce  Plannina  within  predicted  time  frames  and  budgets — often  cutting  calendar  time  in 

y  half  compared  with  earlier  products  developed  without  such  teams.23  In 
addition,  we  identified  two  elements  that  are  essential  to  an  IPT:  the 
knowledge  and  authority  needed  to  recognize  problems  and  make  cross¬ 
cutting  decisions  expeditiously.  We  noted  that  knowledge  is  sufficient 
when  the  team  has  the  right  mix  of  expertise  to  master  the  different  facets 
of  product  development  and  authority  is  present  when  the  team  is 
responsible  for  making  both  day-to-day  decisions  and  delivering  the 
product.  We  concluded  that  if  a  team  lacks  expertise,  it  will  miss 
opportunities  to  recognize  potential  problems  early;  without  authority,  it 
can  do  little  about  them. 

Regarding  broader  human  capital  planning  efforts,  we  first  designated 
strategic  human  capital  management  across  the  government  as  a  high- 
risk  issue  in  2001  because  of  the  federal  government’s  long-standing  lack 
of  a  consistent  approach  to  human  capital  management.  In  February 
201 1 ,  we  narrowed  the  focus  of  this  high-risk  issue  to  the  need  for 
agencies  to  close  mission-critical  skill  gaps.  At  that  time,  we  noted  that 


21ln  2002,  OPM  released  a  Human  Capital  Assessment  and  Accountability  Framework — 
developed  jointly  with  GAO  and  OMB — that  identifies  five  human  capital  systems  that 
together  provide  a  consistent,  comprehensive  representation  of  human  capital 
managementforthe  federal  government(http://www.opm.gov/hcaaf_resource_center/, 
accessed  July  1 , 2016).  In  addition,  GAO  and  OPM  have  established  subsequent 
guidance  on  key  principles  and  steps  associated  with  workforce  planning  thatagencies 
can  utilize  in  their  efforts  to  assess  and  address  IT  skill  gaps.  See  GAO-04-39  andOPM’s 
Workforce  Planning  Model, 

https://www.opm.gov/policy-data-oversight/human-capital-management/reference-material 
si  (accessed  June  7, 2016). 

22GAO,  Standards  for  internal  Control  in  the  Federal  Governm  ent,  GAO-1 4-704G 
(Washington,  D.C.:  Sept.  10,  2014). 

23GAO,  Best  Practices:  DOD  Teaming  Practices  Not  Achieving  Potential  Results, 
GAO-01-510  (Washington,  D.C.:Apr.  10,2001). 
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agencies  faced  challenges  effectively  and  efficiently  meeting  their 
missions  across  a  number  of  areas,  including  acquisition  management.24 

With  regard  to  IT  workforce  and  human  capital  planning,  we  reported  that 
effectively  addressing  mission-critical  skill  gaps  in  IT  requires  a 
multi-faceted  response  from  OPM  and  agencies.25  Specifically,  our  high 
risk  update  in  February  2013  noted  that  OPM  and  agencies  would  need 
to  use  a  strategic  approach  that  (1)  involves  top  management, 
employees,  and  other  stakeholders;  (2)  identifies  the  critical  skills  and 
competencies  that  will  be  needed  to  achieve  current  and  future 
programmatic  results;  (3)  develops  strategies  that  are  tailored  to  address 
skill  gaps;  (4)  builds  the  internal  capability  needed  to  address 
administrative,  training,  and  other  requirements  important  to  support 
workforce  planning  strategies;  and  (5)  includes  plans  to  monitor  and 
evaluate  progress  toward  closing  skill  gaps  and  meeting  other  human 
capital  goals  using  a  variety  of  appropriate  metrics.  We  subsequently 
reported  in  January  2015  that  while  the  Chief  Human  Capital  Officers 
Council  identified  skill  gaps  in  six  government-wide  occupations — 
including  IT/cybersecurity  and  contract  specialist/acquisition — it  would  be 
important  for  lessons  learned  from  these  initial  efforts  to  inform  a  new  set 
of  skill  gaps;  key  features  of  OPM’s  efforts  to  predict  emerging  skill  gaps 
beyond  those  already  identified  were  in  the  early  planning  stages;  and 
OPM  and  selected  agencies  could  improve  efforts  to  address  skill  gaps 
by  strengthening  their  use  of  quarterly  data-driven  reviews. 

Further,  we  have  reported  that  agencies  across  the  federal  government 
have  not  always  effectively  planned  for  IT  workforce  challenges.  For 
example, 

•  We  recently  determined  that  the  Department  of  Veterans  Affairs  (VA) 
had  performed  key  steps  such  as  documenting  an  IT  human  capital 
strategic  plan  and  regularly  analyzing  workforce  data,  but  the 
department  had  not  tracked  and  reviewed  historical  and  projected 
leadership  retirements  and  had  not  identified  gaps  in  future  skill 
areas.26  We  recommended  that  the  department  track  and  review 


24GAO,  High-Risk  Series: An  Update,  GAO-1 1-278  (Washington,  D.C.:  Feb.  16,  201 1 ). 

25GAO,  High-Risk  Series: An  Update,  GAO-13-283  (Washington,  D.C.:  Feb.  14,  2013) 
and  Federal  Workforce:  OPM  and  Agencies  Need  to  Strengthen  Efforts  to  Identify  and 
Close  Mission-Critical  Skills  Gaps,  GAO-15-223  (Washington,  D.C:  Jan.  30,  2015). 

26GAO-1 6-403. 
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historical  workforce  data  and  projections  related  to  leadership 
retirements  and  identify  IT  skills  needed  beyond  the  current  fiscal  year 
to  assist  in  identifying  future  skills  gaps  and  it  concurred  with  our 
recommendations. 

•  We  identified  that  while  the  Federal  Emergency  Management  Agency 
had  taken  initial  steps  to  assess  the  needs  of  its  IT  workforce,  it  had 
not  yet  completed  workforce  planning  efforts  and  lacked  an 
understanding  of  its  regional  IT  workforce.27  For  example,  we  noted 
that  while  it  had  conducted  a  workforce  assessment  to  identify  skill 
levels  of  employees  in  the  agency’s  Office  of  the  CIO,  it  had  not 
completed  recommended  actions  called  for  by  this  assessment.  In 
addition,  its  workforce  planning  efforts  had  not  included  an 
assessment  of  the  many  IT  staff  located  in  the  agency’s  regions  and 
other  offices.  We  concluded  that  the  agency  had  less  assurance  that 
its  IT  workforce  will  have  the  skills  needed  to  successfully  manage  its 
programs  and  recommended  it  establish  time  frames  for  completing 
workforce  planning  efforts.  The  Department  of  Flomeland  Security 
concurred  with  our  recommendations. 

•  In  November  2015,  we  testified  that,  among  other  things,  the  U.S. 
Census  Bureau  faced  challenges  in  the  area  of  workforce  planning.28 
Specifically,  we  noted  that  while  it  had  taken  steps  to  develop  an 
enterprise-wide  IT  workforce  planning  process,  as  we  recommended 
in  2012,  it  had  yet  to  fill  key  positions. 

•  We  have  also  identified  human  capital  challenges  at  the  Social 
Security  Administration  (SSA).29  Specifically,  we  concluded  that 
SSA’s  IT  human  capital  program  had  identified  skills  and 
competencies  to  support  certain  workforce  needs,  but  lacked 
adequate  planning  for  the  future.  The  agency  had  developed  IT 
human  capital  planning  documents,  such  as  an  Information 
Resources  Management  plan  and  skills  inventory  gap  reports,  which 
identified  near-term  needs,  such  as  skill  sets  for  the  following  2  years. 
Nevertheless,  SSA  has  not  adequately  planned  for  longer-term  needs 
because  its  human  capital  planning  and  analysis  were  not  aligned 
with  long-term  goals  and  objectives  and  the  agency  did  not  have  a 
current  succession  plan  for  its  IT  efforts.  Accordingly,  we 


27GAO-1 6-306. 
28GAO-16-205T. 
29GAO-1 4-308. 
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recommended  that  SSA  identify  long-term  IT  needs  in  its  updated 
human  capital  operating  plan  and  the  agency  agreed. 

•  Further,  we  determined  that  eight  selected  agencies  had  taken  varied 
steps  to  implement  workforce  planning  practices  for  cybersecurity 
personnel.30  For  example,  five  of  eight  agencies,  including  the  largest, 
Defense,  had  established  cybersecurity  workforce  plans  or  other 
agency-wide  activities  addressing  cybersecurity  workforce  planning. 
Flowever,  all  of  the  agencies  faced  challenges  determining  the  size  of 
their  cybersecurity  workforce  because  of  variations  in  how  work  was 
defined  and  the  lack  of  an  occupational  series  specific  to 
cybersecurity.  With  respect  to  other  workforce  planning  practices,  all 
agencies  had  defined  roles  and  responsibilities  for  their  cybersecurity 
workforce,  but  these  roles  did  not  always  align  with  guidelines  issued 
by  the  federal  Chief  Information  Officers  Council  and  National  Institute 
of  Standards  and  Technology.  We  also  noted  that  the  robustness  and 
availability  of  cybersecurity  training  and  development  programs  varied 
significantly  among  the  agencies.  We  made  recommendations  aimed 
at  enhancing  individual  agency  cybersecurity  workforce  planning 
activities  and  to  address  government-wide  cybersecurity  workforce 
challenges  through  better  planning,  coordination,  and  evaluation  of 
government-wide  activities.  The  agencies  agreed  with  the  majority  of 
our  recommendations. 

•  Our  review  of  the  Food  and  Drug  Administration  concluded  that, 
among  other  things,  the  agency  was  not  strategically  managing  IT 
human  capital — it  had  not  determined  its  IT  skill  needs  or  analyzed 
gaps  between  skills  on  hand  and  future  needs.31  We  recommended 
that  the  agency  complete  key  elements  of  IT  human  capital  planning; 
the  Food  and  Drug  Administration  concurred  with  our 
recommendation. 


30GAO,  Cybersecurity  Human  Capital:  Initiatives  Need  Better  Planning  and  Coordination, 
GAO-12-8  (Washington,  D.C.:  Nov.  29,2011). 

31GAO-09-523. 
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Three  Characteristics 
Are  Key  to  a 
Comprehensive 
Integrated  Program 
Team;  Shortfalls  Have 
Contributed  to 
Previous  Acquisition 
Problems 


Three  key  characteristics  contribute  to  the  creation  and  operation  of 
comprehensive  IT  acquisition  IPTs:  (1)  effective  executive  leadership 
through  team  support,  empowerment,  and  oversight;  (2)  effective  team 
composition;  and  (3)  effective  processes  for  team  operations.  The  18  key 
practices  associated  with  these  characteristics  provide  additional  detail 
regarding  recommended  practices  for  the  successful  implementation  of 
the  characteristics.32 


32For  details  regarding  sections  ofthe  PMBOK®  Guide  that  we  used  to  supportthe 
developmentof  key  IPT  characteristics, see  appendixl. 
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Figure  1:  Key  Characteristics  and  Key  Practices  of  Comprehensive  Integrated  Program  Teams  (IPT)  for  Major  Information 
Technology  Acquisitions 
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Motivate  team  members  for  success 

Empower  team  to  act 

Provide  sufficient  resources 

Provide  meaningful  oversight 

Resolve  critical  issues 

Determine  necessary  skills,  team  size, 
and  availability 

_  Identify  critical  subject  matter  roles 

and  responsibilities 

Establish  a  cross-functional, 
multidisciplinary  team 

Provide  necessary  training 

Maintain  a  consistent  and  stable  team 
from  beginning  to  end 

Document  the  IPT  charter 

Establish  team  guidelines 

Facilitate  teamwork  through  the  use  of  co-location 

and  virtual  teams 

Involve  stakeholders  as  active  team  members 

Emphasize  the  importance  of  regular  and  effective 

communication 

Ensure  the  appropriate  use  of  contractor  assistance 


Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the  Software  Engineering  Institute;  and  data  from  selected  agency 
chief  information  officers  and  program  offices  from  the  Departments  of  Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 


Teams  Should  Have 
Support,  Empowerment, 
and  Oversight  through 
Effective  Leadership 


The  first  characteristic  of  a  strong  IPT  is  that  executive  leadership, 
external  to  the  team,  provides  the  team  with  support,  empowerment,  and 
oversight.  The  seven  key  practices  provide  details  of  how  executive 
leadership  can  assist  the  IPT,  as  shown  in  figure  2. 
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Figure  2:  Key  Practices  of  Effective  Executive  Leadership  through  Team  Support,  Empowerment,  and  Oversight  for 
Comprehensive  Integrated  Program  Teams  (IPT)  for  Major  Information  Technology  Acquisitions 


Effective  executive  leadership 
through  team  support, 
empowerment,  and  oversight 


Establish  and  maintain  a  shared  vision  and  goals 

Serve  as  an  advocate  for  the  team 

Motivate  team  members  for  success 

Empower  team  to  act 

Provide  sufficient  resources 

Provide  meaningful  oversight 

Resolve  critical  issues 


Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the  Software  Engineering  Institute;  and  data  from  selected  agency 
chief  information  officers  and  program  offices  from  the  Departments  of  Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 


Establish  and  Maintain  a  There  should  be  a  common  understanding  between  executive  leadership, 

Shared  Vision  and  Goals  the  IPT  program  manager,  and  team  members  regarding  the  mission  of 

the  IPT,  its  responsibilities,  and  the  desired  outcome  of  the  program. 
Individual  team  members  should  have  a  shared  definition  of  success,  and 
should  be  encouraged  to  prioritize  team-wide  goals  over  personal  goals. 
Agency  officials  highlighted  the  need  to  establish  and  maintain  a  shared 
vision  and  goals.  Specifically: 

•  General  Services  Administration  (GSA)  officials  told  us  that  IPTs  do 
not  set  their  own  goals.  The  project  is  sponsored  by  management, 
and  the  vision  and  goals  should  be  communicated  by  leadership.  The 
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IPT’s  job  is  to  develop  a  strategy  to  achieve  the  vision  and  goals.  GSA 
officials  added  that  these  teams  should  communicate  the  vision  and 
goals  of  the  program  during  the  solicitation  phase.  During  the 
performance  phase,  vision  and  goals  should  be  aligned  with  service 
level  agreements. 

•  Officials  from  the  National  Oceanic  and  Atmospheric  Administration’s 
(NOAA)  Office  of  the  CIO  noted  that  the  IPT  should  communicate  its 
vision  and  goals  with  its  stakeholders  for  their  review  and  approval 
prior  to  the  project  commencement. 

•  Officials  with  the  Department  of  Commerce’s  (Commerce)  Office  of 
the  CIO  stated  it  is  important  to  ensure  the  team  is  aware  of  the 
shared  vision  and  goals  and  that  the  team  works  with  the  sponsor, 
stakeholders,  and  other  management  to  ensure  the  vision  is  shared 
and  understood  by  all  involved. 

•  Representatives  of  NOAA’s  Geostationary  Operational  Environmental 
Satellite  -  R  series  program  reported  that  team  members  need  to  be 
able  to  perform  tasks  that  are  best  for  the  IPT  and  the  project, 
regardless  of  whether  those  tasks  were  not  originally  assigned  to 
them.  For  example,  members  need  to  break  out  of  the  mentality  of 
being  an  “IT  person”  who  does  not  need  to  assist  with  non-IT  related 
tasks.  Regardless  of  what  expertise  the  member  holds,  he  or  she 
needs  to  work  towards  the  mission  of  the  project. 

•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
added  that  they  work  with  partnering  and  parent  organizations  to 
ensure  decisions  related  to  the  functionality  are  aligned  with  agency 
priorities. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  explained  that  an  IPT  should  be 
committed  to  a  common  purpose.  Work  products  such  as  the  project 
charter  and  program  management  plan  can  be  used  to  communicate 
the  IPT’s  vision  and  goals. 

Serve  as  an  Advocate  for  the  Executive  leadership  should  serve  as  an  active  promoter  for  the  IPT  and 
Team  its  success.  This  focus  can  be  demonstrated  by  leadership  effectively  and 

enthusiastically  communicating  the  vision  and  goals  to  outsiders, 
collaborating  with  other  programs  upon  which  the  team  is  dependent,  and 
managing  the  impact  of  challenges  and  opportunities  from  the  external 
environment. 

For  example,  representatives  from  the  VA  Veterans  Benefits 
Management  System  stated  that  a  major  underlying  contributor  to  the 
progress  of  the  program  has  been  unwavering  support  from  executive 
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Motivate  Team  Members  for 
Success 


Empower  Team  to  Act 


leadership  since  the  project’s  inception.  The  IPT  staff  explained  that 
consistent  oversight  and  executive  involvement  has  had  a  positive  and 
direct  impact  on  the  project’s  overall  probability  of  success  by  removing 
roadblocks,  mitigating  risks,  and  prioritizing  funding. 

Executive  leadership  should  create  an  environment  for  the  IPT  that 
facilitates  success.  This  can  include  things  such  as  team  building 
experiences,  opportunities  for  career  growth  through  challenges, 
feedback  and  support,  and  recognition  and  rewards  for  good 
performance.  For  example,  key  guidance  from  MITRE  Corporation 
recommends  that  periodic  opportunities  be  provided  for  team  members  to 
brief  their  respective  executives  on  aspects  of  their  work. 33  This  may 
provide  individual  members  with  valuable  recognition  from  high  levels 
within  their  own  areas  as  well  as  feedback  to  the  IPT  from  senior 
management.  The  guidance  also  discusses  the  importance  of 
incentivizing  individual  team  members  by  tying  their  performance 
appraisals  and  rewards  to  team  performance.  Officials  with  two  of  the 
agencies  in  our  review  also  mentioned  the  value  of  motiving  team 
members: 

•  Officials  with  Commerce’s  Office  of  the  CIO  stated  that  a  desirable 
IPT  characteristic  includes  teaming.  Teaming  requires  a  true  peer 
environment  where  team  members  are  mutually  accountable  for 
outcomes  and  consensus  building  is  essential. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  noted  that  successful 
IPTs  have  some  level  of  social  interaction  outside  of  professional 
duties  to  smooth  out  communication  barriers  and  build  rapport. 

The  people  assigned  to  an  IPT  should  have  the  appropriate  authority  to 
perform  their  assigned  responsibilities.34  The  boundaries  of  responsibility 
and  authority  between  the  team  and  executive  leadership  should  be 
established  early  and  documented.  Executive  leadership  may  honor 
these  agreements  by  allowing  the  IPT  to  select  its  members,  coordinate 


33MITRE,  Integrated ProjectTeam  (IPT)  Start-up  Guide,  October 2008. ©2008 The 
MITRE  Corporation. 

34ln  2001 ,  we  reported  that  two  elements  are  essential  to  determining  whethera  team  is  in 
fact  an  integrated  product  team:  the  knowledge  and  authorityneeded  to  recognize 
problems  and  make  cross-cutting  decisions  expeditiously.  See  Best  Practices:  DOD 
Teaming  Practices  Not  Achieving  Potential  Results,  GAO-0 1-5 10  (Washington,  D.C.:  Apr. 
10,2001). 
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and  implement  decisions,  take  prudent  risks,  and  exercise  full  day-to-day 
responsibilities  for  delivering  the  product.  An  IPT  should  have  the 
authority  to  make  decisions  and  not  just  serve  as  a  mechanism  for 
communicating  with  stakeholders.  Several  agency  officials  also  discussed 
the  benefits  of  empowering  teams.  Specifically: 

•  Officials  from  the  NOAA  Office  of  the  CIO  stated  that  the  extent  of  the 
IPT’s  authority  should  be  set  by  the  executive  sponsors  based  on  the 
importance  of  the  program.  A  risk-based  approach  should  be  used  to 
identify  the  threshold  of  decision  authority. 

•  According  to  officials  with  Commerce’s  Office  of  the  CIO,  the  IPT 
should  be  able  to  make  most  decisions  as  long  as  it  does  not  over-run 
the  budget,  schedule,  or  scope.  Empowerment  is  critical  to  making 
and  keeping  the  agreements  essential  to  effective  teams. 

•  Representatives  of  NOAA’s  Geostationary  Operational  Environmental 
Satellite  -  R  series  program  noted  that  executive  leadership  should 
only  help  an  IPT  when  appropriate,  otherwise  too  strong  of  a  hand 
from  leadership  can  result  in  micromanagement.  These 
representatives  added  that  IPTs  should  have  enough  decision 
authority  to  push  forward  the  project.  Further,  they  should  not  have  to 
constantly  go  up  the  management  chain  to  make  decisions,  as  this 
would  be  a  clear  indicator  that  the  team’s  authority  is  non-existent. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  explained  that  the  level 
of  decision  making  authority  granted  to  an  IPT  depends  on  the  level  of 
resources,  experience,  human  capital,  and  organization.  It  is 
important  to  hire  quality  resources,  empower  them  to  use  critical 
thinking  and  judgment,  and  support  their  efforts.  Controls  should  be 
implemented  when  these  conditions  are  not  present. 

•  Officials  with  the  VA  Technology  Acquisition  Center  and  the  Office  of 
Information  and  Technology  told  us  that,  in  providing  the  bestvalue  to 
the  VA  customer,  the  IPT  should  have  the  authority  to  decide  on 
requirements  and  the  corresponding  acquisition  milestones  and 
process  to  accomplish  effective  lifecycle  acquisition,  contract,  and 
performance  management. 

•  According  to  officials  from  Defense’s  Office  of  the  Under  Secretary  of 
Defense  for  Acquisition,  Technology,  and  Logistics  and  the  Office  of 
the  CIO,  a  desirable  characteristic  of  an  IPT  is  to  have  empowered 
team  members. 
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Provide  Sufficient  Resources 


Provide  Meaningful  Oversight 


Executive  leaders  outside  of  the  IPT  can  help  to  ensure  its  success  by 
providing  the  resources  necessary  to  do  the  assigned  work.  Resources 
include  funding  to  ensure  the  team  has  adequate  staffing;  physical 
facilities;  security;  and  IT  tools  such  as  environments,  software,  hardware, 
and  networks.  In  that  regard,  it  is  vital  to  have  leadership  support  for  the 
IPT  lead  and  team  members’  roles  and  time  commitments.  Having  this 
support  will  help  enable  the  people  assigned  to  the  IPT  be  able  to  devote 
the  necessary  time  and  effort  to  make  the  program  successful.  Agency 
officials  highlighted  the  importance  of  providing  the  necessary  resources. 
Specifically: 

•  Officials  from  NOAA’s  Office  of  the  CIO  stated  that  each  team 
member  should  have  the  time  to  devote  to  the  IPT  without  distraction. 

•  Representatives  of  NOAA’s  Geostationary  Operational  Environmental 
Satellite  -  R  series  program  explained  that  leadership  should  have  the 
appropriate  understanding  and  awareness  of  what  resources  are 
needed,  such  as  a  sufficient  budget  and  skilled  staff  members.  If 
problems  arise,  senior  executives  need  the  ability  to  bring  in  additional 
resources  that  help  the  program.  IPTs  should  have  access  to  a 
resource  pool  of  needed  expertise  or  talent. 

•  According  to  officials  from  the  VA  Office  of  Information  and 
Technology,  it  is  critical  that  team  members  are  committed  and 
provide  the  necessary  time  for  the  effort  so  that  project  plans  are 
fulfilled,  consistent  with  legitimate  constraints. 

•  Officials  with  the  VA  Technology  Acquisition  Center  noted  that 
members  need  to  be  committed  and  provide  the  necessary  time  to  the 
IPT. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  told  us  that  it  is  critical 
to  have  access  to  resources,  such  as  budget  and  technology,  to  track 
the  program’s  schedule  and  deliverables.  In  addition,  leadership 
support  and  flexibility  are  needed  when  staffing  a  team. 

Executive  leadership  outside  of  the  IPT  should  periodically  evaluate  its 
structure,  operations,  and  results.  Another  important  role  of  leadership 
oversight  is  to  ensure  that  the  shared  vision  and  goals  are  consistently 
pursued  throughout  the  program  lifecycle.  Conducting  such  evaluations 
can  result  in  the  clarification  of  roles  and  responsibilities  and  constructive 
feedback  to  team  members,  the  discovery  of  unrecognized  or  unresolved 
issues,  and  the  establishment  or  modification  of  program  goals  for  the 
future.  Members  should  be  held  accountable  by  leadership  for  their 
individual  performance  as  well  as  overall  program  success.  Agency 
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officials  highlighted  the  need  to  provide  the  IPT  with  meaningful  oversight. 
Specifically: 


•  Officials  with  NOAA’s  Office  of  the  CIO  stated  that  executive 
managers  from  three  offices  (acquisitions,  IT,  and  the  customer 
organization)  work  together  to  approve  the  IPT  and  provide  oversight 
to  hold  it  accountable. 

•  According  to  VA  Veterans  Benefits  Management  System  officials, 

IPTs  at  the  VA  were  held  accountable  through  the  department’s 
Project  Management  Accountability  System,  which  required  that  IT 
projects  deliver  customer-facing  functionality  every  6  months.35 
Through  the  project  management  process,  milestones  are  to  be 
monitored  regularly  and  communicated  to  appropriate  stakeholders. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  stated  that  IPTs  within  the 
department  are  subject  to  regular  reviews  with  senior  leadership 
where  metrics  are  used  to  monitor  progress  and  make  adjustments  as 
appropriate  to  ensure  success.  Representatives  from  the  VA’s  Office 
of  the  CIO  added  that  projects  that  miss  their  delivery  date  are  to  be 
reviewed  by  a  senior  leader  panel  to  identify  root  causes  and  lessons 
learned. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  indicated  that  the  IPT  is 
coordinated  by  a  sector  director,  group  manager,  and  acquisition 
group  manager  based  on  client  needs  and  resource  availability. 

These  three  leadership  stakeholders  are  involved  in  the  gate  review 
process  and  provide  oversight.36  Projects  are  tracked  using  activity 
based  costing.  The  budget  is  set  by  the  group  manager,  and  each 
employee  tracks  their  time  and  cost  against  the  budget.  This  activity 


35The  Project  ManagementAccountability  System  is  VA’s  approach  to  IT  project 
developmentand  delivery  and  the  means  of  holding  IT  project  managers  accountable  for 
meeting  cost,  schedule,  and  scope.  The  system  was  designed  to  reduce  project 
implementation  risks,  institute  monitoring  and  controls,  establish  accountability,  and  create 
a  reporting  discipline.  In  January  20 16,  VA  began  transitioning  from  this  system  to  the 
Veteran-focused  Integration  Process.  VA  plans  to  modify  the  department’s  current 
methodologyintoa  single,  unified,  and  streamlined  release  process  thatfocuses  on 
delivering  high-qualityand  secure  IT  capabilities  to  the  veteran.  VA  plans  to  complete  the 
transition  to  the  Veteran-focused  Integration  Process  bythe  end  of  fiscal  year  2016. 

36Gate  reviews  are  decision  points  in  adevelopmentprocesswhere  project  artifacts  are 
reviewed  againstpre-defined  criteria  to  determine  whether  the  project  is  meeting 
expectations.  If  the  expectations  are  not  met,  corrective  actions  are  implemented. 
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drives  efficiency  on  the  government  side.  Similarly,  every  project 
employs  a  variation  of  project  tracking  using  service  level  agreements, 
deliverables,  and  quality  assurance  surveillance. 

Resolve  Critical  Issues  IPT  leadership,  with  sufficient  autonomy,  should  be  able  to  handle  many 

issues  and  conflicts  on  their  own.  However,  when  an  issue  arises  that 
threatens  to  derail  the  project  and  it  cannot  be  handled  within  the  IPT, 
executive  leadership  must  be  available  and  involved  enough  to  quickly 
and  effectively  resolve  the  issue. 

For  example,  officials  from  NOAA’s  Geostationary  Operational 
Environmental  Satellite  -  R  series  program  explained  that  when  an  issue 
cannot  be  resolved  within  the  IPT,  the  program  manager  should  raise  the 
issue  as  quickly  as  possible  to  a  decision-making  level  where  resolution 
can  be  achieved.  In  addition,  executive  sponsors  help  projects  by 
negotiating  and  addressing  concerns  of  stakeholders  not  directly 
assigned  to  the  team. 


Team  Composition  Should  The  second  key  characteristic  of  a  comprehensive  IPT  for  major  IT 

Be  Highly  Effective  acquisitions  is  to  establish  a  highly  effective  team.  The  five  key  practices 

contribute  to  the  overall  success  of  this  characteristic,  as  shown  in 
figure  3. 
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Figure  3:  Key  Practices  of  Effective  Team  Composition  for  Comprehensive  Integrated  Program  Teams  (IPT)  for  Major 
Information  Technology  Acquisitions 


Effective  team  composition 


Determine  necessary  skills,  team  size, 
and  availability 

Identify  critical  subject  matter  roles 
and  responsibilities 

Establish  a  cross-functional, 
multidisciplinary  team 

Provide  necessary  training 

Maintain  a  consistent  and  stable  team 
from  beginning  to  end 


Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the  Software  Engineering  Institute;  and  data  from  selected  agency 
chief  information  officers  and  program  offices  from  the  Departments  of  Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 


Determine  Necessary  Skills,  Based  on  the  program’s  requirements,  agencies  need  to  develop  a 
Team  Size,  and  Availability  human  resource  management  plan  that  identifies  the  skills  needed  to 

complete  the  work.  Agencies  then  need  to  determine  the  optimal  size  of 
the  core  IPT  team  and  availability  of  other  supplementary  staff.  In  some 
situations,  subject  matter  experts  maybe  assigned  to  work  full  time  on 
the  team,  or  they  may  rotate  in  and  out  based  on  the  need  for  their 
expertise  in  a  given  phase.  Agency  officials  with  whom  we  spoke 
mentioned  the  importance  of  determining  the  required  skills,  optimal  size, 
and  availability.  Specifically: 
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•  According  to  officials  with  Commerce’s  Office  of  the  CIO,  the 
assignment  of  core  and  supplementary  staff  and  subject  matter 
experts  depends  on  the  work  needed  to  be  completed. 

•  Officials  from  NOAA’s  Office  of  the  CIO  also  explained  that  the 
number  and  composition  of  team  members  should  be  commensurate 
with  the  complexity  and  the  scope  of  the  task. 

•  Representatives  from  NOAA’s  Geostationary  Operational 
Environmental  Satellite  -  R  series  program  told  us  that  for  larger 
projects,  staff  should  be  changed  at  specific  phases  of  the  program, 
such  as  when  the  program  transitions  from  development  to 
operations. 

•  Officials  from  Defense’s  Office  of  the  Under  Secretary  of  Acquisition, 
Technology,  and  Logistics  and  the  Office  of  the  CIO  explained  that  the 
program  manager,  stakeholders,  and  customers  should  be  able  to 
assign  any  staff  member  who  would  be  of  value  and  assistance.  Once 
the  effort  is  complete,  the  assigned  staff  member  can  be  released 
from  the  IPT  based  on  the  program  manager’s  assessment  that  the 
resource  is  no  longer  needed.  These  officials  added  that  in  addition  to 
the  program’s  tasks,  functional  capabilities,  and  lifecycle  phase,  the 
size  of  the  IPT  will  vary  based  on  the  acquisition  category  of  the 
program.37 

•  Representatives  from  VA’s  Veterans  Benefits  Management  System 
noted  that  supplementary  staff,  such  as  end  users  and  subject  matter 
experts,  can  become  a  part  of  the  core  IPT  during  times  that 
necessitate  a  specific  level  of  expertise.  These  individuals  can  return 
to  their  regular  duties  once  they  have  fulfilled  their  roles. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  stated  that  it  is  important  to 
ensure  adequate  representation  from  all  major  stakeholder 
organizations,  but  also  to  safeguard  that  the  IPT  does  not  have  too 
many  members. 

•  According  to  representatives  from  the  VA  Technology  Acquisition 
Center  and  the  Office  of  Information  and  Technology,  different 
members  have  different  levels  of  engagement  depending  on  the 
scope  of  the  IPT  and  the  lifecycle  phase  of  the  program.  Staff  may  be 


37Defense  acquisition  programs  are  classified  into  one  of  several  acquisition  categories 
depending  on  the  value  and  type  of  the  materiel,  weapon,  information  system,  or 
capabilitybeing  acquired. 
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Identify  Critical  Subject  Matter 
Roles  and  Responsibilities 


added  later  or  required  to  participate  more  frequently  depending  on 
the  needs  of  the  program. 

Each  program  must  determine  the  appropriate  composition  of  its  IPT. 
Some  roles  and  responsibilities  are  considered  “core,”  meaning  that  each 
team  must  have  these  staff.  For  example,  in  order  for  OMB  to  approve 
the  IT  investment,  an  IPT  must  at  a  minimum  include:  (1)  a  fully  dedicated 
IT  program  manager;  (2)  a  contracting  specialist  (if  applicable);  (3)  an  IT 
specialist;  (4)  an  IT  security  specialist;  and  (5)  a  business  process  owner 
or  a  subject  matter  expert.38  Other  roles  and  responsibilities  are 
considered  “supplementary,”  meaning  that  they  can  be  added  as 
necessary  during  certain  phases  of  the  lifecycle. 

Our  review  of  key  guidance  documentation  and  interviews  with  agency 
officials  indicates  that  an  IPT  for  a  major  IT  acquisition  should  include  a 
number  of  core  disciplines.  Although  the  descriptions  of  the  disciplines 
are  more  detailed  than  those  required  by  OMB,  they  are  still  compatible 
with  OMB’s  five  categories.  For  example,  the  contracting,  procurement, 
and  acquisition  professionals  could  fit  into  OMB’s  category  of  contracting 
specialist.  Similarly,  the  disciplines  of  software  developers,  test  and 
quality  assurance  managers,  engineers,  and  architects  could  fit  into 
OMB’s  category  of  IT  specialist. 

Officials  from  the  eight  organizations  that  we  identified  for  our  sample 
were  largely  in  agreement  with  these  roles  and  responsibilities.  For 
example,  they  all  told  us  that  contracting,  procurement,  and  acquisition 
professionals  were  critical  for  an  IPT.  In  addition,  six  organizations  told  us 
that  that  security  and  privacy  specialists  and  requirements  managers 
should  be  team  members.  At  least  four  of  the  organizations  also 
mentioned  customers  and  users,  budget  and  finance  managers,  software 
developers,  test  and  quality  assurance  managers,  engineers,  risk 
managers,  and  sponsors. 

The  core  disciplines  are  shown  in  figure  4  by  descending  order  in  which 
they  were  cited  in  literature  and  by  selected  organizations,  and  discussed 
in  more  detail  following  the  figure. 


38OMB,  Circular  No.  A-1 1:  Preparation,  Submission,  and  Execution  of  the  Budget,  Part  7, 
Capital  Programming  Guide  (June  201 5)  and  FY17  IT  Budget  -  Capital  Planning 
Guidance  (June  22,  2015),  accessed  at 

https://www.whitehouse.gov/omb/e-gov/strategiesandguideson  Sept.  27, 2016. 
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Figure  4:  Frequency  by  which  Core  Disciplines  Were  Cited  in  Literature  and  by  Selected  Organizations  for  Comprehensive 
Integrated  Program  Teams  for  Major  Information  Technology  Acquisitions 


Contracting,  procurement,  and 
acquisition  professionals 

Program  managers 

Customers  and  users 

Budget  and  finance  professionals 

Security  and  privacy  specialists 
Software  developers 
Requirements  managers 
Test  and  quality  assurance  managers 
Engineers 
Architects 
Risk  managers 
Sponsors 


Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the  Software  Engineering  Institute;  and  data  from  selected  agency 
chief  information  officers  and  program  offices  from  the  Departments  of  Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 


Contracting,  procurement,  and  acquisition  professionals 

These  positions  include: 

•  Contracting  officers,  who,  according  to  OMB,  evaluate  technical 
competency  of  contractors  and  establish  acquisition  strategies  to 
achieve  the  best  value  for  taxpayer  dollars.39  They  and  their  support 
staff  analyze  proposals,  provide  independent  cost  estimates,  and 


39OMB,  Guidance  for  Specialized  Information  Technology  Acquisition  Cadres, 
(Washington,  D.C.:  July  13,  201 1)  and  U.S.  Digital  Services  Playbook  (accessed  at 
https://playbook.cio.gov/on  Aug.  23,  2016). 
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develop  negotiation  positions.  They  legally  obligate  the  government 
when  they  enter  into  contracts. 

•  Contracting  officer’s  representatives,  who  manage  ongoing  contractor 
performance  to  ensure  the  government’s  interests  are  protected.  They 
are  designated  and  authorized  in  writing  by  the  contracting  officer  to 
perform  specific  technical  or  administrative  functions  on  contracts  or 
orders. 

•  Purchasing  agents  and  procurement  specialists,  who  assist 
contracting  professionals  with  a  wide  range  of  duties,  such  as  market 
research  and  file  preparation,  tracking  procurements,  and  preparing 
awards  for  simple  acquisitions. 

•  Contract  specialists,  who,  according  to  OMB,  support  the  contracting 
officers  in  accomplishing  their  many  duties  during  the  pre-  and  post¬ 
award  acquisition  phases.40  Contract  specialists  may  also  perform  the 
role  of  contracting  officers  for  small  dollar  value  procurements. 

Program  managers 

At  the  hub  of  an  effective  IPT  is  a  strong  program  manager  who  stewards 
the  process  from  beginning  to  end  while  achieving  the  program’s  cost, 
schedule,  and  performance  goals.  The  program  manager  could  come 
from  either  the  technology  or  mission  organization,  so  long  as  the  person 
possesses  skills  in  both  areas  and  operates  under  a  strong  governance 
process.  Further,  he  or  she  should  ideally  be  highly  proficient  at  technical, 
business  (both  government  and  commercial  business  processes), 
organizational,  programmatic,  and  interpersonal  levels. 

Customers  and  users 

Members  of  the  organization  who  will  approve,  accept,  and  ultimately  use 
the  deliverables  or  products  of  the  project  on  a  day-to-day  basis  should 
be  assigned  to  the  IPT  to  ensure  proper  coordination;  advise  on 
requirements  including  business  policies,  rules,  and  processes;  and 
validate  the  acceptability  of  the  project’s  results. 


40OMB,  Guidance  for  Specialized  Information  Technology  Acquisition  Cadres 
(Washington,  D.C.:  July 201 1 ). 
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Budget  and  finance  professionals 


Personnel  from  budget  and  finance  are  necessary  to  secure  the  required 
funding  for  the  program.  Their  involvement  during  the  acquisition  process 
can  help  in  the  development  of  the  acquisition  strategy  and  limit  potential 
problems  related  to  financial  and  budgetary  issues. 

Security  and  privacy  specialists 

An  IPT  should  include  government  employees  who  are  experts  in  system 
security.  In  addition,  the  sustained  engagement  of  privacy  specialists 
helps  ensure  that  personal  data  is  properly  managed. 

Software  developers 

Members  of  the  team  should  have  experience  with  traditional  and  modern 
development  techniques  such  as  Agile  software  development  concepts 
and  modular  approaches.41 

Requirements  managers 

The  team  should  have  a  requirements  manager  who  understands  the 
lifecycle  of  managing  requirements  starting  with  elicitation  through  the 
requirements  change  management  process  to  test  and  evaluation. 

T est  and  quality  assurance  managers 

The  test  manager  brings  a  solid  end-to-end  view  of  the  testing  process, 
including  test  management  and  the  use  of  automated  testing  frameworks. 
Quality  assurance  personnel  ensure  consistency  and  quality 
documentation. 

Engineers 

Engineers  translate  operational  needs  and  requirements  into  a  set  of 
system  product  and  process  solutions  that  satisfy  customer  needs. 


41  Agile  software  development  cal  Is  for  the  delivery  of  software  in  small,  short  increments 
rather  than  in  the  typically  long,  sequential  phases  of  a  traditional  waterfall  approach. 
More  a  philosophythan  a  methodology,  Agile  emphasizes  this  earlyand  continuous 
software  delivery,  as  well  as  using  collaborative  teams,  and  measuring  progress  with 
working  software.  A  mod ular approach  uses  standard  interfaces  where  feasible  to  enable 
maintenance  and  support,  and  prevent  obsolescence  issues. 
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Architects 


Teams  benefit  from  having  IT  architects  who  can  develop  a  solution  that 
will  interoperate  with  the  agency’s  internal  and  external  systems. 

Risk  managers 

IPTs  should  include  risk  managers  who  are  knowledgeable  in  the 
processes  of  risk  management.  This  includes  risk  identification,  analysis, 
and  response  planning  that  may  decrease  the  likelihood  and  impact  of 
negative  events  in  the  program. 

Sponsors 

Each  IPT  should  include  the  sponsor,  who  is  the  executive-level  person 
or  group  who  provides  resources  and  support  for  the  program  and  who  is 
ultimately  responsible  and  accountable  for  enabling  its  success. 

In  addition  to  the  core  disciplines,  other  supplementary  staff  members 
could  be  added  to  the  IPT  on  an  as-needed  basis.  These  include 
positions  such  as: 

•  Administrative  personnel.  These  personnel  are  responsible  for 
activities  such  as  document  management,  communications,  outreach, 
and  meeting  facilitation  and  recording. 

•  Organizational  change  managers.  These  managers  execute 
strategies  and  techniques  required  for  effectively  planning, 
implementing,  and  evaluating  change  in  the  organization. 

•  Configuration  managers.  These  managers  apply  principles  and 
methods  for  planning  and  managing  the  implementation,  update,  and 
integration  of  information  systems  components. 

•  Earned  value  management  specialists.  These  specialists  can  combine 
scope,  schedule,  and  resource  measurements  to  help  the  program 
team  assess  and  measure  project  performance  and  progress. 

•  Human  resources  representatives.  Human  resources  representatives 
are  involved  in  (1)  identifying  and  documenting  project  roles, 
responsibilities,  required  skills,  and  reporting  relationships;  (2) 
confirming  human  resource  availability;  (3)  improving  competencies, 
team  member  interaction,  and  team  environments;  and  (4)  tracking 
team  member  performance,  providing  feedback,  and  resolving  issues. 
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Establish  a  Cross-Functional, 
Multidisciplinary  Team 


•  Governance  managers.  Governance  managers  are  IT  officials 
involved  with  strategic  capital  planning  and  investment  control 
processes. 

•  Schedulers.  Schedulers  plan,  develop,  manage,  execute,  and  control 
the  program  schedule  in  order  to  ensure  the  timely  completion  of  the 
project. 

•  Designers.  Designers  have  core  knowledge  of  sustainable  design. 

•  Legal  counsel.  Counsel  should  have  the  expertise  to  assist  with 
acquisition-related  and  legal  issues  such  as  the  award  of  contracts, 
intellectual  property  rights,  licenses,  and  other  matters. 

•  Operational  support  personnel.  These  personnel  are  responsible  for 
activities  such  as  system  operations,  implementation/deployment 
management,  software  maintenance,  training,  customer  service,  and 
system  performance.  They  can  be  from  external  organizations  that 
have  a  relationship  with  the  program  to  provide  specialized  expertise 
or  fill  a  specified  role,  such  as  IT  system  installation,  customization,  or 
training. 

Ideally,  the  team  will  not  only  consist  of  members  from  a  wide  selection  of 
subject  matter  disciplines,  but  individual  members  will  also  have  a  variety 
of  technical  skills  and  expertise.  In  addition,  important  soft  skill  sets  may 
also  be  considered.  These  include  skills  such  as  problem  solving  and 
decision-making,  interpersonal  skills,  ability  to  communicate  and  work 
with  customers,  team  building,  and  conflict  resolution.  One  of  the  more 
important  soft  skills  is  the  ability  to  deal  with  adversity  and  ever  changing 
circumstances.  Specifically  for  the  program  manager,  important  selection 
criteria  include:  (1)  lack  of  bias,  (2)  technical  expertise,  (3)  project 
management  skills,  (4)  ability  to  manage  external  environment,  (5)  team 
engagement  skills,  (6)  decisiveness,  (7)  time  management  skills,  (8) 
ability  to  effectively  elevate  and  delegate  decisions,  and  (9)  commitment 
to  the  IPT’s  work.  Several  agency  officials  discussed  the  value  of  both 
technical  and  non-technical  attributes.  Specifically: 

•  Officials  with  Commerce’s  Office  of  the  CIO  explained  that  a  desirable 
characteristic  of  an  IPT  is  integration,  which  is  embodied  by  bringing 
together  different  organizations  that  have  a  stake  in  the  program, 
each  providing  differing  perspectives  and  skills  which  are  vital  to  the 
successful  outcome.  Each  team  should  possess  the  knowledge  to 
collaboratively  identify  problems  and  propose  solutions,  minimizing 
the  amount  of  rework  that  has  to  be  done. 

•  According  to  officials  from  NOAA’s  Office  of  the  CIO,  members  should 
be  capable  of  providing  input  regarding  multiple  disciplines,  not  just 
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their  area  of  primary  responsibility.  They  added  that  on  a 
multidisciplinary  team  often  the  best  team  members  are  individuals 
who  have  multiple  types  of  expertise. 

•  Representatives  from  NOAA’s  Geostationary  Operational 
Environmental  Satellite  -  R  series  program  stated  that  IPTs  should 
have  personnel  with  specialized  skill  sets  to  bridge  any  gaps  in  the 
program.  They  should  also  have  cross-functional  skill  sets  that  enable 
effective  communication  with  managers  inside  and  outside  of  their 
primary  knowledge  domain. 

•  GSA  Assisted  Acquisition  Services,  Federal  Systems  Integration  and 
Management  Center  officials  explained  that  they  have  created  a 
structure  that  integrates  the  acquisition  workforce  with  the  technical 
resources  under  the  same  management.  In  addition,  they  have 
developed  a  role  called  the  acquisition  project  manager,  which  is  a 
hybrid  position  of  technical  expertise  and  acquisition  knowledge  that  is 
present  for  pre-award  activities  such  as  technical  evaluations.  The 
representatives  added  that  the  integration  of  acquisition  and  technical 
resources,  sharing  the  same  management,  leads  to  more  efficiency 
and  alignment  with  the  mission. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  told  us  that  it  is  desirable  for  IPT 
members  to  have  the  necessary  acquisition,  business,  technical  and 
programmatic  knowledge,  as  well  as  the  expertise  to  facilitate  and 
leverage  the  process  to  help  define  user  needs,  facilitate  discussions, 
make  recommendations,  resolve  issues,  and  make  decisions. 

•  VA  Veterans  Benefits  Management  System  officials  explained  that  the 
most  critical  characteristic  of  a  comprehensive  IPT  is  a  joint  team 
consisting  of  IT  resources  and  business  resources,  where  the  IT  staff 
understands  the  business  needs  of  the  users  and  the  users  have  the 
technical  experience  to  assess  alternative  IT  solutions  and  weigh  the 
tradeoffs  of  each.  Officials  told  us  that  they  attempted  to  ensure 
frequent  collaboration  between  business  and  IT  team  members  during 
key  phases  of  projects — from  planning  to  deployment.  They  stated 
that  this  practice  was  essential  to  the  delivery  of  functionality  to  end- 
users. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  stated  that  desirable  non¬ 
technical  skills  of  IPT  members  include  problem  solving  and  decision¬ 
making,  team  building,  interpersonal  skills,  and  conflict  resolution. 

•  Officials  with  Commerce’s  Office  of  the  CIO  noted  that  adaptability  is 
a  desirable  characteristic  of  an  IPT  member. 
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Provide  Necessary  Training 


Maintain  a  Consistent  and 
Stable  Team  from  Beginning  to 
End 


•  Representatives  from  NOAA’s  Geostationary  Operational 
Environmental  Satellite  -  R  series  program  said  that  IPT  members 
need  to  be  flexible  and  open  to  change  when  needed  to  address 
team -wide  priorities. 

The  IPT  needs  to  ensure  that  its  members  have  received  two  types  of 
training:  (1)  training  related  to  their  specific  roles  and  (2)  training  related 
to  their  involvement  in  an  IPT  in  general.  The  first  type  of  training  involves 
measuring  the  skills  and  knowledge  of  the  staff  in  relation  to  their  roles. 
Based  on  this  assessment,  the  team  should  provide  role-specific  training 
as  necessary  to  support  the  execution  of  the  program.  Providing 
cross-training  to  team  members  can  reduce  problems  which  arise  during 
member  absences.  For  the  second  type  of  training,  the  team  should 
provide  its  members  with  IPT-specific  training  to  create  the  knowledge 
and  culture  necessary  to  ensure  its  success.  This  can  include  training  on 
items  such  as  (1)  the  purpose  of  an  IPT,  (2)  why  an  IPT  is  being  used  in 
this  case,  (3)  how  an  IPT  needs  to  function,  and  (4)  behavior  and  skills 
required  of  IPT  leaders  and  members.  This  training  will  require  the  use  of 
additional  resources  upfront,  but  it  can  result  in  greater  team 
effectiveness  and  efficiencies  later.  Officials  from  Commerce  mentioned 
the  value  in  ensuring  appropriate  training.  Specifically: 

•  Officials  from  NOAA’s  Office  of  the  CIO  told  us  that  in  addition  to 
having  knowledge  regarding  the  mission  subject,  team  members  need 
the  proper  training  in  IPT  framework  and  discipline. 

•  Representatives  from  Commerce’s  Office  of  the  CIO  explained  that 
training  will  assist  with  ensuring  all  of  the  team  members  are  on  board 
with  the  new  program,  especially  if  they  are  being  taken  from  their 
normal  daily  duties. 

The  core  members  of  the  team,  including  all  leadership  roles,  should  be 
in  place  throughout  the  program  lifecycle.  IPTs  should  be  in  place  from 
the  initial  concept  and  development  phases,  through  the  delivery  and 
implementation  of  the  last  increment  under  the  contract.  The  team  lead 
should  be  100  percent  dedicated  to  the  program  during  this  time  frame. 
However,  there  maybe  instances  where  other  team  member  services  are 
not  needed  on  a  full-time  basis.  In  those  cases,  team  member  support  to 
the  IPT,  when  needed,  should  take  priority  over  the  team  member’s  other 
duties.  It  is  also  ideal  to  have  contractor  staff  who  are  stable  and 
consistent.  Having  continuity  of  government  and  contractor  staff  working 
on  a  project  throughout  its  lifecycle  reinforces  accountability.  Agency 
officials  discussed  the  importance  of  maintaining  stability  in  the  team. 
Specifically: 
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•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
and  NOAA’s  Geostationary  Operational  Environmental  Satellite  -  R 
series  program  stated  that  core  staff  should  be  assigned  to  the  IPT  for 
the  duration  of  the  program. 

•  According  to  representatives  from  the  VA  Technology  Acquisition 
Center  and  the  Office  of  Information  and  Technology,  members 
should  be  available  for  the  duration  of  the  IPT,  adding  that 
commitment  and  regular  and  consistent  participation  are  critical  to  the 
success  of  the  team. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  noted  IPT  members 
should  be  assigned  as  soon  as  the  requirements  are  known.  Each 
member  should  have  a  clear  expectation  for  the  level  of  involvement, 
time  frame  for  participation,  and  response  at  the  conclusion  of  the 
phase.  They  also  stated  that  roles  and  responsibilities  of  team 
members  should  be  revisited  at  each  phase  of  the  acquisition. 

•  Representatives  from  Commerce’s  Office  of  the  CIO  noted  that  it  is 
desirable  that  backup  representatives  on  the  IPT  be  well  apprised  of 
the  team’s  agenda,  issues,  and  decisions. 


Teams  Should  Operate  The  third  and  final  key  characteristic  is  to  operate  the  team  using  effective 
Using  Effective  Processes  processes.  As  shown  in  figure  5,  six  key  practices  provide  additional 

detail  for  the  successful  implementation  of  this  characteristic. 
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Figure  5:  Key  Practices  of  Effective  Processes  for  Team  Operations  for  Comprehensive  Integrated  Program  Teams  (IPT)  for 
Major  Information  Technology  Acquisitions 


Document  the  IPT  charter 

Effective  processes  Establish  team  guidelines 

for  team  operations  Facilitate  teamwork  through  the  use  of  co-location 

and  virtual  teams 

Involve  stakeholders  as  active  team  members 

Emphasize  the  importance  of  regular  and  effective 
communication 

Ensure  the  appropriate  use  of  contractor  assistance 


Source:  GAO  analysis  of  relevant  guidance  from  recognized  sources  including  MITRE,  the  Project  Management  Institute,  Inc.,  and  the  Software  Engineering  Institute;  and  data  from  selected  agency 
chief  information  officers  and  program  offices  from  the  Departments  of  Commerce,  Defense,  Veterans  Affairs,  and  the  General  Services  Administration.  |  GAO-17-8 

Document  the  IPT  Charter  The  IPT  should  have  a  charter  that  documents  its  need,  purpose,  and 

scope.  The  charter  should  further  clarify  and  elaborate  goals,  outcomes, 
and  performance  measures.  In  addition,  it  should  be  reviewed  by,  and 
receive  concurrence  from,  executive  leadership.  It  should  also  be  updated 
as  necessary,  but  at  least  at  the  start  of  each  work  phase.  Agency 
officials  mentioned  the  value  of  documenting  the  team’s  charter. 
Specifically: 

•  Officials  with  Commerce’s  Office  of  the  CIO  stated  that  the  charter 
should  be  established  early  on  in  the  planning  process,  and  it  should 
include  (1)  the  expectations  of  the  program  team,  (2)  the  scope  of  the 
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IPT’s  authority,  (3)  the  metrics  by  which  the  success  of  the  IPT  will  be 
evaluated,  (4)  the  identification  of  the  customers,  (5)  the  amount  and 
types  of  funds  available  to  the  IPT,  and  (6)  the  expertise  the  team 
must  have. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  told  us  that  the  charter  should 
document  the  roles  and  responsibilities  of  each  team  member. 

•  According  to  officials  with  Defense’s  Office  of  the  Under  Secretary  of 
Acquisition,  Technology,  and  Logistics  and  the  Office  of  the  CIO,  the 
charter  should  document  the  customers,  end  users,  and  other 
stakeholders  who  have  a  vested  interest  in  the  outcome  of  the  IPT. 

Establish  Team  Guidelines  For  effective  operations,  it  is  important  to  create  and  document 

IPT-specific  decision-making  processes  that  align  with  the  organization’s 
policies  and  procedures.  These  include  rules  and  guidelines  for  things 
such  as:  (1)  team  structuring,  (2)  formal  lines  of  communication,  (3) 
establishment  of  authority,  (4)  resource  allocation,  (5)  work  review  and 
approval,  and  (6)  reporting  requirements.  Several  agency  officials 
discussed  the  importance  of  providing  the  IPT  with  rules  and  guidelines. 
Specifically: 

•  Officials  from  NOAA’s  Office  of  the  CIO  explained  that  the  team 
should  establish  the  mission  criteria,  schedule,  and  performance 
measures  before  the  program  begins.  The  IPT  should  report  on  the 
status  at  the  expected  intervals  using  monthly  written  status  reports 
and  quarterly  project  reviews. 

•  Representatives  of  NOAA’s  Geostationary  Operational  Environmental 
Satellite  -  R  series  program  told  us  that  team  members  should 
understand  their  roles  and  responsibilities  so  they  know  what  is 
required  of  them  and  the  value  they  bring  to  the  team. 

•  According  to  representatives  from  the  VA  Veterans  Benefits 
Management  System,  they  document  roles  and  responsibilities, 
including  an  organizational  chart  and  a  responsibility  assignment 
matrix. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  told  us  that  each  member  needs 
to  have  his  or  her  role  defined  based  on  expertise. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  stated  that  an  IPT 
should  have  defined  roles  and  responsibilities,  as  well  as  consistent, 
mature  processes.  To  that  end,  they  have  established  standard 
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Facilitate  Teamwork  through 
the  Use  of  Co-Location  and 
Virtual  Teams 


operating  procedures,  training,  and  templates  for  organizations  to  use. 
These  include  (1)  a  roles  and  responsibilities  matrix  template  to 
document  the  structure,  roles  and  responsibilities,  and  operating 
procedures;  (2)  a  project  management  tool  to  document  the 
acquisition  schedule  and  to  provide  a  quick  overview  of  dates  for 
major  milestones;  and  (3)  an  acquisition  start  meeting  template  to 
document  the  roles,  responsibilities,  existing  information,  acquisition 
schedule,  procurement  integrity  briefing,  project  administration,  and 
next  steps. 

•  Defense’s  Office  of  the  Under  Secretary  of  Acquisition,  Technology, 
and  Logistics  and  the  Office  of  the  CIO  officials  stated  that  each  IPT’s 
structure  should  be  individualized  based  on  the  program’s  task, 
acquisition,  type  of  capability,  technology,  operational  mission,  and 
other  various  factors. 

Co-location  places  many  or  all  of  the  most  active  team  members  in  the 
same  physical  location.  The  benefits  of  co-location  can  include  easier 
information  sharing  and  communication,  earlier  identification  of  issues, 
and  more  effective  decision  making.  At  a  minimum,  the  IPT  lead  and  the 
contracting  officer  should  be  co-located.  However,  co-location  is  not 
always  practical.  Another  option  is  temporary  co-location — bringing  staff 
members  together  on  a  limited  basis  during  strategically  important  times. 
For  example,  an  especially  important  time  is  requirements  definition, 
which  is  an  area  where  translation  issues  between  business  users  and 
developers  can  cause  problems  if  requirements  are  not  clearly 
articulated,  understood,  and  documented.  As  an  alternative,  effective 
virtual  teams  can  be  created  through  the  use  of  shared  networks, 
software,  tools,  databases,  and  teleconferencing,  which  allows  team 
members  from  different  locations  to  work  together  regardless  of  the 
physical  location.  According  to  recognized  guidance,  the  benefits  of 
virtual  teams  include  the  addition  of  skilled  resources,  reduced  travel  and 
re-location  costs,  and  the  proximity  of  team  members  to  other  critical 
resources.42  Agency  officials  highlighted  the  need  to  make  trade-offs  to 
facilitate  teamwork.  Specifically: 

•  Officials  with  Commerce’s  Office  of  the  CIO  explained  that  IPTs  are 
not  periodic  meetings;  rather  they  are  daily  work  routines  where 
members  must  work  closely  with  their  teammates  and  the  program 


42Project  Management  Institute,  Inc.,  A  Guide  to  the  Project  Management  Body  of 
Knowledge  (PMBOK®  Guide),  Fifth  Edition,  201 3.  PMBOK  isa  trademark  ofthe  Project 
Management  Institute,  Inc. 
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manager  to  produce  a  viable  product  as  defined  by  business 
requirements.  As  such,  co-location  of  all  members  is  preferable  as  it 
facilitates  frequent  and  timely  discussions,  problem-solving,  and 
decision-making.  NOAA  demonstrated  commitment  to  this  approach 
with  its  Geostationary  Operational  Environmental  Satellite  -  R  series 
program.  Although  the  program  is  overseen  internally  within 
Commerce,  it  relies  on  acquisition  experience  and  technical  expertise 
supplied  by  the  National  Aeronautics  and  Space  Administration.  In 
order  to  leverage  this  knowledge,  NOAA  implemented  an  integrated 
program  management  structure  and  located  the  program  office  at  the 
National  Aeronautics  and  Space  Administration’s  Goddard  Space 
Flight  Center.  Officials  with  the  Geostationary  Operational 
Environmental  Satellite  -  R  series  program  told  us  that  bringing  team 
members  to  the  Goddard  Space  Flight  Center  was  advantageous 
because  the  co-location  ensured  that  engineering  resources  were 
available,  if  needed. 

•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
told  us  that  they  use  a  mix  of  virtual  teams  and  co-location  as 
appropriate.  For  example,  temporary  co-location  often  occurs  during 
requirements  elicitation,  system  design,  and  user  acceptance  testing. 

•  Officials  from  the  Defense’s  Office  of  the  Under  Secretary  of 
Acquisition,  Technology,  and  Logistics  and  the  Office  of  the  CIO  noted 
that  co-locating  team  members  is  desirable  but  not  mandatory  in 
today’s  virtual  world.  The  use  of  virtual  technology  provides  a  means 
for  high  success  in  meeting  the  goals  and  objectives  of  the  IPT 
without  all  members  being  co-located.  For  example,  the  use  of  virtual 
technologies  such  as  teleconferencing,  portals,  instant  messaging, 
and  e-mails  may  help  ensure  requirements  are  clearly  articulated  and 
adequate  oversight  of  the  contracted  work  is  accomplished. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  told  us  that  geography 
matters  and  there  is  no  substitute  for  face-to-face  communication. 
Ideally  the  program  manager  should  work  in  the  same  location  as  the 
customer  at  least  2  days  a  week  to  provide  the  best  customer  service 
possible.  Flowever,  officials  added  that  they  have  examples  of 
successful  IPTs  where  the  team  is  not  co-located.  In  those  cases,  the 
use  of  virtual  tools  such  as  telephone,  e-mail,  online  documents,  video 
chat,  web  messaging,  and  virtual  meetings  assisted  in  ensuring  a 
seamless  acquisition  process. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  stated  that  although  they 
consider  co-location  to  be  optimal,  it  is  not  always  practical.  As  a 
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result,  they  often  use  on-line  tools  to  facilitate  effective  virtual 
meetings. 

Involve  Stakeholders  as  Active  Stakeholders  are  individuals  or  groups  affected  by  the  outcome  of  a 

Team  Members  project,  and  may  or  may  not  be  assigned  to  the  core  team.  Either  way, 

stakeholder  involvement  should  be  viewed  as  a  valuable  asset  to  the 
team,  and  stakeholder  satisfaction  should  be  seen  as  a  key  project 
objective.  Stakeholders  should  represent  all  relevant  acquisition, 
technical,  support,  and  operational  organizations.  They  are  working  team 
members  and  should  be  included  in  activities  such  as  planning,  decision¬ 
making,  commitments,  communication,  coordination,  reviews,  appraisals, 
requirements  definition,  and  resolution  of  problems  and  issues.  Reviews 
and  exchanges  are  regularly  conducted  with  stakeholders  to  ensure  that 
coordination  issues  receive  appropriate  attention  and  everyone  involved 
with  the  project  is  appropriately  aware  of  status,  plans,  and  activities.  The 
involvement  of  stakeholders  is  especially  important  in  Agile  development, 
which  emphasizes  collaboration  more  than  traditional  approaches  do.  For 
example,  in  Agile  development,  project  status  is  primarily  evaluated 
based  on  demonstrations  of  working  software  provided  to  stakeholders 
and  customers.43  Agency  officials  with  whom  we  spoke  discussed  the 
value  of  actively  involving  stakeholders.  Specifically: 

•  Officials  with  Commerce’s  Office  of  the  CIO  stated  that  ensuring  the 
stakeholders  were  supportive  from  the  beginning  to  the  end  of  the 
program  was  a  critical  success  factor. 

•  Representatives  with  NOAA’s  Office  of  the  CIO  noted  that  the  IPT 
should  engage  with  internal  stakeholders  through  weekly  or  monthly 
status  reports,  monthly  or  quarterly  interim  project  reviews,  and 
milestone  briefings. 

•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
told  us  that  engaging  with  stakeholders  requires  ongoing  collaboration 
and  open  communication  to  ensure  transparency  and  the  optimization 
of  inputs  and  ideas.  They  also  explained  that  the  program  solicited 
users’  input  on  requirements  for  the  development  and  enhancement 
of  the  system.  Field  subject  matter  experts  from  across  the  country 
participated  in  requirements,  design,  and  testing  sessions  with  system 
developers. 


43GAO,  Software  Development:  Effective  Practices  and  Federal  Challenges  in  Applying 
Agile  Methods,  GAO-12-681  (Washington,  D.C.:  July  27, 2012). 
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Emphasize  the  Importance  of 
Regular  and  Effective 
Communication 


•  Representatives  from  the  VA  Technology  Acquisition  Center  stated 
that  IPTs  should  communicate  with  internal  and  external  stakeholders 
regarding  the  status  and  progress  of  the  project. 

•  According  to  officials  in  VA’s  Office  of  Information  and  Technology, 
the  appropriate  representation  within  the  team  ensures  that  all 
stakeholders  are  aware  of  and  committed  to  completing  key  project 
deliverables  on  time.  This  approach  enables  and  requires  coordinated 
teamwork  from  multiple  organizations  to  be  a  key  driver  of  the 
project’s  daily  performance.  In  addition,  they  noted  that  the  customer 
community  is  involved  in  several  ways  throughout  the  project  lifecycle. 
For  example,  the  business  sponsor  is  a  representative  and  advocate 
for  the  customer  community.  The  customer  community  is  involved 
throughout  the  lifecycle  of  the  project,  and  makes  the  final 
determination  of  acceptability  in  user  testing  to  accept  delivery  of 
capabilities. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  told  us  that  IPTs  should 
engage  with  internal  and  external  stakeholders  as  often  as  feasible. 
They  explained  that  it  is  important  for  the  team  to  fully  understand  the 
political  landscape  and  be  able  to  identify  all  critical  stakeholders  early 
in  the  process.  Subsequently,  teams  should  engage  with  stakeholders 
by  keeping  key  players  involved  in  the  process  to  ensure  they  are 
working  toward  meeting  the  mission  and  strategy  goals. 

•  Officials  from  Defense’s  Office  of  the  Under  Secretary  of  Acquisition, 
Technology,  and  Logistics  and  the  Office  of  the  CIO  stated  that  teams 
should  engage  with  stakeholders  on  a  regular  basis  and  as  frequently 
as  possible. 

Ideally,  the  amount  of  communication  and  the  manner  in  which  it  is 
documented  would  be  tailored  to  fit  the  needs  of  the  team.  For  example, 
teams  may  establish  regularly  scheduled  meetings.  Records  from  the 
meetings  can  be  maintained  in  a  form  that  allows  for  ready  access  at  a 
later  date.  In  addition,  teams  may  establish  methods  to  identify  and 
resolve  conflicts  that  arise  among  stakeholders.  According  to  recognized 
guidance,  IPTs  need  to  be  particularly  sensitive  to  the  internal  dynamics 
and  style  of  interaction  between  members  both  during  and  outside  of 
meetings.44  It  can  be  helpful  to  have  ground  rules  about  how  to 
respectfully  share  and  acknowledge  different  points  of  view,  ensure 


44MITRE,  Integrated ProjectTeam  (IPT)  Start-up  Guide,  October 2008. ©2008 The 
MITRE  Corporation. 
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balanced  participation  from  all  members,  build  trust  and  collegiality,  deal 
with  conflict,  and  maintain  morale  and  team  spirit.  The  use  of  a  facilitator 
during  meetings  could  be  a  valuable  tool  in  effective  communications. 
Agency  officials  with  whom  we  spoke  mentioned  the  importance  of 
communication.  Specifically: 

•  Officials  from  Commerce’s  Office  of  the  CIO  stated  that 
communications  should  be  tailored  to  the  technical  level  of  the 
audience.  One  effective  method  of  communication  is  the  use  of  a 
program  management  tool  to  allow  team  members  to  access  any 
information  at  any  time.  Communications  should  be  two-way;  there 
should  be  a  way  for  the  stakeholders  to  provide  feedback  to  the  IPT. 

•  Officials  with  NOAA’s  Office  of  the  CIO  told  us  that  the  frequency  of 
communication  should  be  commensurate  with  the  scope  and 
complexity  of  the  milestone  or  urgency  of  the  pace  of  tasks. 

•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
explained  that  they  have  found  that  frequent  and  structured  meetings 
are  the  most  effective  way  of  communicating  progress  and  addressing 
issues.  The  IPT  participated  in  daily  and  weekly  meetings  to  discuss 
key  topics,  risks,  and  issues.  In  addition,  functionality-specific 
meetings  occur  on  an  as-needed  basis  to  ensure  continued 
collaboration.  Communication  could  be  facilitated  by  an  intranet  site,  a 
suite  of  communication  materials,  downloadable  toolkits,  factsheets, 
and  explanatory  videos  designed  to  build  awareness  and  provide 
necessary  information  for  customers  and  end-users.  Officials  reported 
that  information  sharing  and  coordination  with  other  VA  organizations 
ensures  awareness  and  understanding  of  changes  prior  to 
implementation.  In  addition,  engaging  stakeholders  across  multiple 
vehicles  on  a  recurring  basis  was  integral  to  the  responsive  and 
iterative  approach  of  the  team. 

•  Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  Information  and  Technology  stated  that  they  communicate 
progress  and  issues  by  meeting  regularly  (e.g.,  weekly/monthly), 
documenting  results  and  issues  in  meeting  minutes,  conducting 
formal  milestone  reviews,  and  escalating  issues  as  necessary. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  told  us  that  after  an 
initial  acquisition  kickoff  meeting,  the  team  works  together  to  setup 
standing  weekly  (or  more  frequent  depending  on  the  project) 
meetings.  During  these  meetings,  they  review  schedules,  plans,  and 
deliverables  with  each  other  and  the  client.  The  IPT  should  be 
communicating  often  to  ensure  members  are  always  working  towards 
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the  same  goal.  Once  a  week  the  program  manager  updates  the 
acquisition  schedule  so  that  leadership  has  the  most  up-to-date 
information.  Once  a  systemic  process  exists  for  schedule 
communication,  management  can  more  easily  identify  outliers  and 
focus  on  addressing  problem  areas.  During  the  various  meetings, 
team  members  must  have  the  opportunity  to  voice  dissent.  Once 
decisions  are  made,  the  team  must  reach  buy-in  and  proceed. 

•  According  to  officials  from  Defense’s  Office  of  the  Under  Secretary  of 
Acquisition,  Technology,  and  Logistics  and  the  Office  of  the  CIO,  the 
IPT  should  have  regularly  scheduled  meetings,  at  least  monthly,  or 
more  frequently  if  software  is  being  deployed  more  often.  Meetings 
are  intended  to  bring  together  the  program  office,  contractors, 
technical  expertise,  stakeholders,  customers,  and  others  to  view  the 
development,  progress,  and  issues  related  to  acquisition  of  the 
capability.  In  addition,  there  should  be  opportunities  to  discuss 
matters  between  meetings.  There  should  be  open  discussions  with  no 
secrets. 

Ensure  the  Appropriate  Use  of 

Contractor  Assistance 


•  Officials  from  NOAA’s  Office  of  the  CIO  stated  that  an  IPT  can  benefit 
from  contractors  serving  as  administrative  staff  and  subject  matter 
experts.  However,  the  number  of  government  team  members  should 
be  equal  to  or  greater  than  the  number  of  contractors.  Contractor  staff 
should  not  be  making  important  business  decisions,  and  government 
staff  should  review  and  approve  recommendations  made  by 
contractors. 

•  Officials  with  Commerce’s  Office  of  the  CIO  told  us  that  the  ratio  of 
government  staff  to  contractor  staff  should  not  matter  as  long  as  the 
contractor  is  doing  the  scoped  work,  maintaining  its  metrics,  being 
held  to  specific  performance  standards,  and  overseen  by  the 
contracting  officer’s  representative.  However,  they  noted  that  IPTs 
should  try  to  keep  a  ratio  of  government  to  contractor  staff  that 
ensures  enough  government  participation  so  that  decisions,  changes, 
and  approvals,  can  be  executed  in  an  efficient  manner,  and  the 
government  maintains  accountability  and  traceability. 


The  IPT  is  often  assigned  the  responsibility  to  oversee  the  performance 
and  acceptance  of  contractors’  deliverables  or  services.  If  the  contractors 
bear  a  large  share  of  the  risk  for  delivering  the  project’s  results,  they  may 
play  a  significant  role  on  the  project  team.  The  goal  is  to  ensure  that 
government  personnel  maintain  control  over  key  decisions  and 
expenditure  of  funds.  Agency  officials  with  whom  we  spoke  highlighted 
the  importance  of  effectively  overseeing  contractors’  activities. 
Specifically: 
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•  Officials  with  the  VA  Technology  Acquisition  Center  and  the  Office  of 
Information  and  Technology  stated  that  contractors  can  serve  in 
support  functions  such  as  document  preparation  and  meeting 
facilitation.  However,  any  inherently  government  function  that  requires 
decision-making  should  not  be  performed  by  contractors.45 
Representatives  from  the  VA  Technology  Acquisition  Center  and  the 
Office  of  the  CIO  also  agreed  that  that  the  majority  of  personnel  on  an 
IPT  should  be  government  employees.  In  addition,  officials  noted  that 
any  poor  performance  by  contractors  can  be  documented  in 
performance  reviews  and  can  lead  to  corrective  actions,  or  if 
necessary,  contract  termination.  Finally,  according  to  VA  officials, 
contractor  personnel  should  sign  non-disclosure  agreements. 

•  Representatives  from  the  VA  Veterans  Benefits  Management  System 
noted  that  contractors  can  complement  the  IPT’s  effectiveness  by 
providing  experiences  or  resources  in  areas  such  as  systems 
engineering,  software  development,  testing,  requirements  analysis, 
communication,  change  management,  business  architecture,  and 
program  management.  However,  the  team  members  need  to  follow 
the  roles,  rules,  and  guidance  set  forth  by  the  Federal  Acquisition 
Regulation.  Specifically,  the  government  staff  are  to  perform  and 
complete  inherently  government  tasks  and  contractors  only  perform 
work  based  on  the  statement  of  work  for  which  they  have  an  approved 
contract.46  In  addition,  VA  officials  noted  that  each  contract  is  to  have 
a  dedicated  contracting  officer  representative  responsible  for  ensuring 
contract  deliverables  meet  quality  and  schedule  parameters 
established  by  the  government. 

•  Representatives  from  GSA’s  Assisted  Acquisition  Services,  Federal 
Systems  Integration  and  Management  Center  explained  that  it  is 
important  to  document  roles,  responsibilities,  and  expectations  of  any 
contractor  team  member.  According  to  these  officials,  the  contracting 
officer,  contract  specialist,  and  program  manager  should  be 


45An  inherentlygovernmental  function  is  one  that  is  so  intimately  related  to  the  public 
interestas  to  mandate  performance  bygovernmentemployees.  These  functions  include 
those  activities  that  require  the  exercise  of  discretion  in  applying  governmentauthority,  the 
use  of  judgment  in  making  decisions  for  the  government,  and  decisions  regarding 
monetarytransactions  and  entitlements.  See  Federal  Acquisition  Regulation,  48  C.F.R. 
2.101 .  The  Federal  Acquisition  Regulation  requires  that  specific  procedures  be  in  place 
before  contracting  for  services  to  ensure  thatinherentlygovernmental  functions  are 
performed  by  government  personnel.  Federal  Acquisition  Regulation,  48  C.F.R.  37.503(c). 
The  Federal  Acquisition  Regulation  listsexamplesofinherentlygovernmental  activities  in 
subpart7.5,  including  several  procurement-related  activities. 

46See  48  C.F.R.  7.503. 
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government  employees,  not  contractor  employees.  However,  these 
officials  stated  that  functions  such  as  assisting  the  program  manager 
with  financial  management,  tracking  schedules,  preparing 
deliverables,  creating  an  operational  framework,  and  serving  as  a 
technical  writer  are  appropriate  uses  of  contractor  resources. 

Shortfalls  in  Building 

Strong  IPTs  Have 
Contributed  to  Significant 
Problems  in  Major  IT 
Acquisitions 

The  presence — or  absence — of  these  IPT  characteristics  can  have  an 
impact  on  the  success  or  failure  of  a  program.  We  have  previously 
reported  on  weaknesses  in  practices  related  to  each  of  three 
characteristics  (effective  leadership,  team  composition,  and  processes) 
that  have  adversely  impacted  major  IT  acquisitions. 

Shortfalls  in  leadership.  Our  recent  review  of  the  Department  of 
Homeland  Security’s  Human  Resources  Information  Technology 
investment  revealed  a  lack  of  oversight  from  the  department’s  executive 
steering  committee.47  For  example,  the  executive  steering  committee  met 
only  once  from  September  2013  through  June  2015 — in  July  2014 — and 
was  minimally  involved  with  overseeing  the  investment’s  15  key  areas 
identified  as  needing  improvement  during  that  period.  As  a  result  of  the 
executive  steering  committee  not  meeting,  important  governance 
activities  were  not  completed,  including  review  of  the  investment’s  key 
strategic  planning  document.  We  reported  that  this  this  lack  of 
involvement  contributed  to  Department  of  Homeland  Security  being  able 
to  deliver  only  1  of  15  human  resources  capabilities  which  the  department 
said  would  be  mostly  implemented  by  June  2015.  Until  the  executive 
steering  committee  effectively  carries  out  its  oversight  responsibility,  the 
department  will  be  limited  in  its  ability  to  improve  human  resource 
investments  which  are  needed  to  carryout  its  mission. 

Shortfalls  in  team  composition.  Our  previous  work  on  efforts  of  VA  to 
share  electronic  health  records  with  Defense  highlights  the  importance  of 
having  sufficient  staff  on  the  IPT.48  Specifically,  in  2009  the  two 
departments  set  up  an  Interagency  Program  Office  to  oversee  the 
development  of  fully  interoperable  electronic  health  records.49  The  office 

47GAO,  Homeland  Security:  Oversight  of  Neglected  Human  Resources  Information 
Technology  Investment  is  Needed,  GAO-16-253  (Washington,  D.C.:  Feb.  1 1 , 2016). 

48GAO,  Electronic  Health  Records:  Long  History  of  Management  Challenges  Raises 
Concerns  ab out  VA’s  and  DOD’s  New  Approach  to  Sharing  Health  Information, 

GAO-1 3-41 3T  (Washington,  D.C.:  Feb.  27,2013). 

49The  Interagency  Program  Office  was  established  pursuant  to  the  National  Defense 
Authorization  Act  for  Fiscal  Year  2008,  Pub.  L.  No.  1 10-181 ,  §  1635  (Jan.  28,  2008). 
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was  given  the  responsibility  for  oversight  and  management,  stakeholder 
communication,  and  decision-making.  Specific  tasks  included  the 
development  of  a  plan,  schedule,  and  performance  measures  to  guide  the 
departments’  interoperability  efforts.  In  February  201 1 ,  we  reported  that 
the  Interagency  Program  Office  had  not  fulfilled  some  of  its  major 
responsibilities.  The  office  was  subsequently  re-chartered  and  given  more 
staff  to  complete  its  work.  Specifically,  officials  with  the  Interagency 
Program  Office  noted  that  it  was  authorized  to  eventually  have  a  staff  of 
236  personnel,  more  than  7  times  the  number  originally  allotted. 

Plowever,  the  officials  stated  that  as  of  January  2013,  the  office  was 
staffed  at  only  62  percent — 146  personnel.  Officials  stated  that  hiring 
additional  staff  remained  one  of  its  biggest  challenges.50 

As  another  example,  our  ongoing  work  regarding  the  U.S.  Census 
Bureau’s  plans  to  conduct  the  2020  Census  has  demonstrated  the  need 
to  provide  its  staff  training  related  to  program  roles  and  responsibilities.51 
Specifically,  in  2013  the  Census  Bureau  measured  the  skills  and 
knowledge  of  the  staff  by  conducting  a  workforce  competency 
assessment.  The  assessment  identified  several  mission-critical  gaps.  For 
example,  the  agency  found  that  competency  gaps  existed  in  cloud 
computing,  security  integration  and  engineering,  enterprise/mission 
engineering  lifecycle,  requirements  development,  and  Internet  data 
collection.  It  also  found  that  enterprise-level  competency  gaps  existed  in 
program  and  project  management,  budget  and  cost  estimation,  systems 
development,  data  analytics,  and  shared  services.  These  mission-critical 
gaps  would  have  challenged  the  Census  Bureau’s  ability  to  deliver  critical 
IT-related  initiatives.  In  response,  the  agency  identified  actions  to  close 
the  competency  gaps  by  December  201 5,  including  several  training- 
related  actions.  For  example,  it  planned  to  implement  centralized  and 
integrated  professional  training  and  development  activities,  create 
environments  conducive  to  on-the-job  training  from  embedded  personnel, 
and  leverage  staff  with  related  knowledge  and  experiences  to  provide 
in-house  workshops  that  share  skills  and  experiences.  We  reported  that 
fully  implementing  these  activities  would  be  critical  to  ensuring  that  the 


50ln  February  2013,  VA  and  Defense  ultimatelydecided  to  abandon  their  plan  of 
developing  a  single  system,  and  reverted  to  each  modernizing  their  own  existing  systems. 

51GAO,  2020  Census:  Key  Information  Technology  Decisions  Must  Be  Made  Soon, 

GAO-1 6-205T  (Washington,  D.C.:  Nov.  3,  201 5)  and  2020  Census:  Key  Challenges  Need 
to  Be  Addressed  to  Successfully  Enable  Internet  Response,  GAO-1 5-225  (Washington, 
D.C.:  Feb.  5,2015). 
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Census  Bureau  has  the  skills  it  needs  to  effectively  develop  and 
implement  systems  vital  to  the  upcoming  Census. 

Shortfalls  in  team  processes.  Our  prior  work  on  the  Federal  Aviation 
Administration’s  acquisitions  program  for  air  traffic  control  facilities 
demonstrated  the  problems  associated  with  processes  that  did  not 
facilitate  sufficient  involvement  of  stakeholders  throughout  the  system’s 
development.52  Specifically,  the  Federal  Aviation  Administration  did  not 
include  air  traffic  controllers  in  the  design  and  testing  of  one  of  its  integral 
air  traffic  control  programs.  Because  of  this,  issues  that  could  have  been 
addressed  early  in  the  design  phase  were  not  discovered  until 
implementation,  resulting  in  costand  schedule  impacts.  Partly  due  to  not 
having  valuable  stakeholder  involvement,  the  program  experienced  a 
cumulative  60  percent  cost  increase  and  schedule  delays  averaging  4 
years.  In  response,  the  agency  took  steps  to  involve  stakeholders  by 
signing  a  memorandum  of  understanding  with  the  air  traffic  controllers’ 
union.  The  memorandum  called  for,  among  other  things,  a  team  of  16 
controllers  to  be  detailed  from  various  locations  to  test  and  validate 
software  fixes  with  engineers  at  the  Federal  Aviation  Administration 
Technical  Center. 

As  another  example,  our  prior  review  of  the  United  States  Department  of 
Agriculture’s  Farm  Service  Agency’s  Modernize  and  Innovate  the  Delivery 
of  Agricultural  Systems  program  showed  that  agency  policies  for  effective 
communication  were  not  followed.53  For  example,  the  program  did  not 
keep  records  of  which  artifacts  were  reviewed  during  meetings  to  assess 
system  developmental  progress  and  maturity  and  did  not  adequately 
track  decisions  and  corrective  actions.  This  hindered  executive  level 
governance  over  the  program,  which  contributed,  in  part,  to  significant 
challenges  for  the  program.  As  a  result  of  these  challenges,  further 
development  of  the  system  was  ultimately  halted  after  the  program  had 
spent  about  $423  million  and  delivered  only  about  20  percent  of  the 
functionality  which  had  been  envisioned. 

Implementing  the  key  characteristics  of  IPTs  for  major  IT  acquisitions  can 
mitigate  the  risk  of  aforementioned  problems  from  occurring.  Also  key  to 


52GAO,  Air  Traffic  Control  Modernization:  ManagementChattenges  Associated  with 
Program  Costs  and  Schedules  Could  HinderNextGen  Implementation,  GAO-12-223 
(Washington,  D.C.:  Feb.  16,2012). 

53GAO,  Farm  Program  Modernization:  Farm  Service  Agency  Needs  to  Demonstrate  the 
Capacity  to  Manage  IT  Initiatives,  GAO-15-506  (Washington,  D.C.:  June  18,  2015). 
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an  agency’s  success  in  developing  IPTs  is  sustaining  a  workforce  with  the 
necessary  knowledge,  skills,  and  abilities  to  execute  a  range  of 
management  functions  that  support  its  mission  and  goals. 


Selected 

Departments  Had 
Mixed  Progress  in 
Assessing  Their  IT 
Skill  Gaps 


One  key  element  cuts  across  the  characteristics  and  practices  needed  to 
build  a  strong  IPT:  IT  workforce  planning.  For  example,  leadership  needs 
accurate  information  about  the  team’s  staffing  needs  in  order  to  provide 
sufficient  staffing  resources.  Agencies  can  help  ensure  IPTs  have  the 
requisite  skill  sets,  team  size,  and  set  of  disciplines  by  developing 
competency  and  staffing  requirements,  assessing  gaps,  and  developing 
strategies  and  plans  to  address  those  gaps  through  additional  training  or 
other  measures.  Agencies  can  also  utilize  staffing  strategies,  such  as 
contractor  assistance,  if  appropriate,  to  address  IT  skill  gaps  and  ensure 
effective  team  operations. 

As  discussed  previously  in  this  report,  a  number  of  federal  laws  as  well  as 
guidance  issued  by  OMB  and  OPM  address  IT  workforce  planning 
activities  for  federal  agencies.  Several  of  the  requirements  and 
recommended  practices  from  those  sources  also  generally  align  with  key 
principles  and  activities  identified  in  our  and  OPM’s  strategic  workforce 
planning  models.  Consequently,  to  support  the  evaluation  of  whether 
selected  federal  agencies  are  adequately  assessing  and  addressing  gaps 
in  IT  knowledge  and  skills,  we  established  an  evaluation  framework 
based  on  these  laws  and  guidance,  and  vetted  it  with  internal  and 
external  stakeholders.54 

The  framework  contains  four  steps:  (1)  setting  the  strategic  direction  for 
IT  workforce  planning,  (2)  analyzing  the  IT  workforce  to  identify  skill  gaps, 

(3)  developing  and  implementing  strategies  to  address  IT  skill  gaps,  and 

(4)  monitoring  and  reporting  progress  in  addressing  IT  skill  gaps.  Each  of 
the  four  steps  is  supported  by  key  activities.  Table  1  summarizes  the  four 
steps  and  eight  key  activities  used  in  our  evaluation  of  selected  federal 
agencies. 


54We  did  not  perform  a  legal  analysis  as  to  whetherthe  selected  agencies  were  in  actual 
compliance  with  the  laws  we  used  to  derive  ourevaluation  framework. 
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Table  1:  Summary  of  Key  Information  Technology  (IT)  Workforce  Planning  Steps 
and  Activities 


Key  workforce  planning  steps  and  activities 

Set  the  strategic  direction  for  I T  workforce  planning 
Establish  and  maintain  a  workforce  planning  process 
Develop  com petencyand  staffing  requirements 
Analyze  the  IT  workforce  to  identify  skill  gaps 
Assess  com  petencyand  staffing  needs  regularly 
Assess  gapsin  competencies  and  staffing 

Develop  strategiesand  implementactivitiesto  address  IT  skill  gaps 
Develop  strategies  and  plans  to  address  gaps  in  competencies  and  staffing 

Implementactivities  thataddress  gaps  (including  IT  acquisition  cadres,  cross-functional 
training  of  acquisition  and  program  personnel,  career  paths  for  program  managers,  plans 
to  strengthen  program  management,  and  use  of  special  hiring  authorities) 

Monitor  and  report  progress  in  addressing  I T  skill  gaps 

Monitorthe  agency’s  progress  in  addressing  competencyand  staffing  gaps 

Report  to  agency  leadership  on  progress  in  addressing  competencyand  staffing  gaps 


Source:  GAO  analysis  of  strategic  human  capital  planning  and  IT  workforce  planning  activities  from  legislation  including  the  Clinger- 
Cohen  Act  of  1996,  E-Government  Act  of  2002,  Federal  Cybersecurity  Workforce  Assessment  Act  of  2015,  and  FITARA;  OMB 
guidance  including  25  Point  Implementation  Plan  to  Reform  Federal  Information  Technology  Management,  Guidance  for  Specialized 
Information  Technology  Acquisition  Cadres,  Management  and  Oversight  of  Federal  Information  Technology  (M-15-14),  Cybersecurity 
Strategy  and  Implementation  Plan  for  the  Federal  Civilian  Government  (M- 16-04),  Federal  Cybersecurity  Workforce  Strategy  (M-16-15), 
and  Circular  A- 130,  Managing  Information  as  a  Strategic  Resource',  OPM  guidance  including  IT  Program  Management  Career  Path 
Guide  and  Workforce  Planning  Model ;  and  prior  GAO  reports,  including  GAO-04-39  and  GAO-14-704G.  |  GAO-17-8 


When  effectively  implemented,  IT  workforce  planning  activities  can 
facilitate  the  success  of  major  IT  acquisitions.  Ensuring  program  staff 
have  the  necessary  knowledge  and  skills  is  a  factor  commonly  identified 
as  critical  to  the  success  of  major  IT  investments.55  If  agencies  are  to 
ensure  that  this  critical  success  factor  has  been  met,  then  IT  skill  gaps 


55GAO-12-7. 
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need  to  be  adequately  assessed  and  addressed  through  a  workforce 
planning  process.56 

Selected  federal  departments  had  mixed  progress  in  assessing  their  IT 
skill  gaps.  While  they  have  demonstrated  important  progress  in  either 
partially  or  fully  implementing  key  IT  workforce  planning  activities,  each  of 
the  five  departments  had  shortfalls.  The  five  departments  have  started 
focusing  on  identifying  cybersecurity  staffing  gaps,  but  more  work 
remains  in  assessing  competency  gaps  and  in  broadening  the  focus  to 
include  the  entire  IT  community.  Figure  6  illustrates  the  extent  to  which 
selected  departments  have  fully,  partially,  or  not  implemented  key  IT 
workforce  planning  activities. 


56An  agency’s  skill  gap  can  manifest  its  elf  in  a  variety  of  ways.  For  the  purposes  of  this 
report,  a  skill  gap  may  consist  of  one  or  more  of  the  following:  a  (1 )  “staffing  gap,”  in  which 
an  agency  has  an  insufficient  number  of  individuals  to  complete  its  work,  such  as  a  lack  of 
contracting  officers  within  its  workforce;  and/ora  (2)  “competencygap,”in  which  an 
agency  has  individuals  without  the  appropriate  ski  liabilities,  or  behaviors  to  successfully 
perform  the  work,  such  as  an  IT  workforce  withoutup-to-date  cybersecurity  skills.  This 
definition  is  based  on  the  Strategic  Human  Capital  ManagementHigh  Risk  Initiative’s 
definition  of  “skills  gap,”  as  outlined  in  its  July  201 2  status  report.  This  High  Risk  Initiative 
was  an  18  month  jointinitiative  launched  in  September201 1  by  OPM  and  the  Chief 
Human  Capital  Officers  Council  to  address  critical  skill  gaps  in  the  federal  government. 
Additionally,  we  use  OPM’s  definition  of  a  competencywhich  refers  to  the  knowledge, 
skills,  abilities,  behaviors,  and  othercharacteristics  needed  byan  individual  to  successfully 
perform  theirwork  or  occupation. 
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Figure  6:  Selected  Departments’  Implementation  of  Eight  Key  Information  Technology  (IT)  Workforce  Planning  Activities 


Total  number  of  activities 


Department  of 
Commerce 


Department  of 
Defense 


Department  of 
Health  and 
Human  Services 


Department  of 
Transportation 


Department  of 
the  Treasury 


Agencies 


Number  of  activities  fully  implemented 
Number  of  activities  partially  implemented 
|  Number  of  activities  not  implemented 

Source:  GAO  analysis  of  departments’  data.  ]  GAO-17-8 


As  shown  in  the  figure,  of  the  five  departments,  Defense  had  the  most 
robust  implementation  with  all  eight  activities  fully  or  partially 
implemented. 
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Commerce  Commerce  has  not  yet  established  a  process  to  guide  its  IT  workforce 

planning  activities.  Of  the  eight  activities  to  assist  an  agency  with  effective 
workforce  planning,  Commerce  has  partially  implemented  three  activities 
and  has  not  implemented  five  activities.  Table  2  identifies  the  extent  to 
which  Commerce  has  implemented  key  IT  workforce  planning  steps  and 
activities. 


Table  2:  Evaluation  of  the  Department  of  Commerce’s  (Commerce)  Implementation  of  Key  Information  Technology  (IT) 
Workforce  Planning  Steps  and  Activities 


Key  steps  and  activities 

Rating 

Description 

Set  the  strategicdirectionfor  IT 
workforce  planning 

Establish  and  maintain  a  workforce 
planning  process 

Not  implemented 

Commerce  has  not  implemented  this  activity.  In  December2015, 
the  department  reported  that  it  is  not  yet  in  compliance  with  the 

Office  of  Managementand  Budget’s  requirementto  establish  an  IT 
workforce  planning  processand  has  notyet  identified  planned 
actions  ormilestonestodoso. 

Develop  com  petencyand  staffing 
requirements 

Partially  implemented 

Officials  stated  the  department  has  taken  steps  to  identify 
competencyrequirementsforits  IT  workforce  by  performing  a 
review  of  four  IT-related  competencymodels  and  frameworks. 

While  Commerce  has  institutionalized  one  ofthe  competency 
models  forIT  program  managers  through  its  acquisition  manual,  the 
departmenthas  notyet  adopted  the  other  competencymodels  for 
its  remaining  IT workforce.  In  addition,  Commerce  officials  stated 
that  the  departmenthad  identified  staffing  level  targets  several 
years  ago,  but  does  not  have  current  targets. 

Analyze  the  IT  workforce  to  identify  skill 
gaps 

Assess  competencyand  staffing 
needs  regularly 

Not  implemented 

Commerce  has  not  implemented  this  activity.  The  departmenthas 
not  performed  regular  assessments  of  competency  or  staffing 
needs. 

Assess  gaps  in  competencies  and 
staffing 

Partially  implemented 

Commerce  has  partiallyassessed  gaps  in  competenciesand 
staffing.  In  written  responses,  the  departmentidentified  its  top 
cybersecurity  staffing  gaps.  However,  it  has  notyet  assessed  gaps 
in  competencies forits  workforce. 

Develop  strategies  and  implement 
activities  to  address  IT  skill  gaps 

Develop  strategies  and  plans  to 
address  gaps  in  competencies  and 
staffing 

Not  implemented 

Commerce  has  not  implemented  this  activity.  Departmentofficials 
stated  that  they  are  currently  developing  strategies  to  address 
staffing  level  gaps  within  the  IT  workforce  but  did  not  provide  details 
on  the  strategies  being  developed  ortimeframes  for  completion. 
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Key  steps  and  activities 

Rating 

Description 

Implementactivities  thataddress 
gaps  (including  IT  acquisition 
cadres,  cross-functional  training  of 
acquisition  and  program  personnel, 
career  paths  for  program 
managers,  plans  to  strengthen 
program  management,  and  use  of 
special  hiring  authorities) 

Partially  implemented 

Commerce  has  partiallyimplemented  activities  thataddress  gaps. 
For  example,  the  departmentdeveloped  an  acquisition  manual  that 
identifies  education,  experience,  and  training  requirements  for 
program  and  projectmanagers  who  are  primarilyresponsibleforthe 
acquisition  of  IT  investments.  However,  the  departmenthas  notyet 
established  an  IT  acquisition  cadre,  provided  cross -functional 
training  of  acquisition  and  program  personnel,  developed  a  career 
path  for  program  managers,  orutilized  special  hiring  authorities. 
Further,  since  the  departmenthas  notyet  fully  assessed 
com  petencyand  staffing  gaps  for  its  workforce  it  has  not  yet 
implemented  activities  to  address  them. 

Monitor  and  reportprogress  in 
addressing  IT  skill  gaps 

Monitor  the  agency’s  progress  in 
addressing  competencyand 
staffing  gaps 

Not  implemented 

Commerce  has  not  implemented  this  activity.  Departmentofficials 
noted  that  they  are  in  the  process  of  establishing  methodsto 
gather,  assess,  and  report  information  on  IT  s  kill  gaps . 

Reportto  agency leadershipon 
progress  in  addressing  competency 
and  staffing  gaps 

Not  implemented 

Commerce  has  not  implemented  this  activity.  According  to 
departmentofficials,  they  are  in  the  process  ofestablishing 
methods  to  gather,  assess,  and  report  information  on  IT  skill  gaps. 

Source:  GAO  analysis  of  Commerce  data.  |  GAO- 17-8 


Several  circumstances  have  contributed  to  the  department’s  shortfalls  in 
IT  workforce  planning.  For  example,  Commerce’s  efforts  to  gather  and 
utilize  information  for  IT  workforce  planning  have  been  ad  hoc.  While 
Commerce  participated  in  a  government-wide  IT  workforce  assessment  in 
201 1 ,  it  was  unable  to  demonstrate  how  it  used  information  from  the 
assessment  for  determining  IT  competency  and  staffing  requirements, 
identifying  gaps,  and  developing  strategies  to  address  gaps.  Further,  the 
department  attempted  to  collect  updated  data  in  recent  years  on  IT 
workforce  staffing  levels,  certifications,  and  skill  gaps.  Flowever,  it  was 
unable  to  demonstrate  how  they  used  this  information  for  workforce 
planning  and  noted  that  data  collected  in  2015  on  skill  gaps  were  not 
used  because  the  data  were  unreliable.  In  addition,  Commerce  officials 
noted  that  while  the  department  has  begun  to  draft  IT  competency 
requirements  and  has  reviewed  several  sources,  the  department  does  not 
yet  have  policies  and  procedures  that  incorporate  key  IT  workforce 
planning  steps  and  activities. 

Commerce  officials  acknowledged  that  shortfalls  exist  in  the  department’s 
workforce  planning  activities  and  stated  that  they  are  working  to  develop 
a  more  effective  IT  workforce  assessment  plan  in  fiscal  year  2017.  Until 
Commerce  fully  implements  key  IT  workforce  planning  activities, 
management  will  have  a  limited  ability  to  assess  and  address  gaps  in 
knowledge  and  skills  that  are  critical  to  the  success  of  major  acquisitions. 
As  a  result,  it  will  be  more  difficult  to  anticipate  and  respond  to  changing 
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staffing  needs  and  control  human  capital  risks  when  developing, 
implementing,  and  operating  critical  IT  systems. 

Defense 

Defense  has  established  processes  that  have  enabled  it  to  perform  key 
analyses  and  assessments  on  its  IT  workforce.  Specifically,  of  the  eight 
activities  associated  with  workforce  planning,  the  department  has  fully 
implemented  one  and  has  partially  implemented  seven.  Table  3  identifies 
the  extent  to  which  Defense  has  implemented  key  IT  workforce  planning 
steps  and  activities. 

Table  3:  Evaluation  of  the  Department  of  Defense’s  (Defense)  Implementation  of  Key  Information  Technology  (IT)  Workforce 
Planning  Steps  and  Activities 

Key  steps  and  activities 

Rating 

Description 

Set  the  strategicdirection  for  IT  workforce 
planning 

Establish  and  maintain  a  workforce 
planning  process 

Implemented 

Defense  has  established  a  strategic  workforce  planning  process 
for  its  IT  functional  communitythat  includes  steps  forsetting 
direction, analyzing  the  workforce,  implementing  strategies,  and 
monitoring  progress. 

Develop  competencyand  staffing 
requirements 

Partially 

implemented 

Defense  has  partiallydeveloped  competencyand  staffing 
requirements  forIT  staff.  Of  the  department’s  18IT-related 
occupations,  Defense  hasdeveloped  competencies  fortwo 
miss  ion-critical  occupations  and  one  additional  occupation. 
Separately,  the  department  has  developed  a  set  of  competencies 
for  individuals  with  IT  acquisition  responsibilities  thatare 
incorporated  into  a  set  of  education,  experience,  and  training 
requirements.  Defense  has  defined  staffing  targets  for  all  18 
occupations  and  forindividuals  with  acquisition  responsibilities. 
However,  Defense  has  notyet  established  competency 
requirementsforall  IT  staff.  Of  its  18occupations,the 
departmenthas  notestablished  competenciesforone  mission- 
critical  occupation  and  14  other  occupations. 

Analyze  the  IT  workforce  to  identify  skill 
gaps 

Assess  competencyand  staffing  needs 
regularly 

Partially 

implemented 

Defense  has  partiallyassessed  IT  competencyand  staffing 
needs.  Regarding  the  acquisition  workforce,  the  department  has 
reassessed  compete ncyrequirements  regularlyth rough 
reviewing  and  updating  its  set  of  competencies  forthis 
community.  With  respectto  the  broader  IT  workforce,  Defense 
has  assessed  competencyneeds  fortwo  of  its  three 
miss  ion-critical  occupations  and  identified  staffing  level  targets 
for  all  1 8  IT  occupations.  However,  the  departmenthas  notyet 
regularlyassessed  competencyneeds  forall  IT  staff,  including 
one  mission-critical  occupation  and  14  otheroccupations. 
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Key  steps  and  activities 

Rating 

Description 

Assess  gaps  in  competencies  and 
staffing 

Partially 

implemented 

Defense  has  also  partiallyassessed  gaps  in  IT  competencies 
and  staffing.  Regarding  the  IT  acquisition  workforce,  the 
departmenthas  assessed  competencygaps  bymeasuring  rates 
of  certification  againstdefined  education,  training,  and 
experience  thresholds.  With  respectto  the  broaderIT  workforce, 
Defense  has  assessed  staffing  gaps  through  its  Strategic 
Workforce  Plans  for  fiscal  years  2013-2018  and  fiscal  years 
2014-2019.  While  Defense  has  recently  identified  competency 
gaps  for  two  of  three  mission-critical  IT  occupations,  the 
departmenthas  notyet  identified  competencygaps  forstaff  in  its 
third  mission-critical  occupation  and  14  other  occupations. 

Develop  strategies  and  implementactivities 
to  address  IT  skill  gaps 

Develop  strategies  and  plans  to  address 
gaps  in  competenciesand staffing 

Partially 

implemented 

Defense  has  partiallydeveloped  strategies  and  plans  to  address 
gaps  in  IT  competenciesand  staffing. The departmentdeveloped 
strategies  and  plans  to  address  staffing  gaps  identified  in  its 
Strategic  Workforce  Plan  for  fiscal  years  2013-2018.  Defense 
has  also  developed  strategies  thataddress  its  broadergoals  of 
transitioning  to  a  cyberspace  workforce  management  approach 
consisting  ofstaff  performing  s ignificant  IT  and  cybersecurity 
roles,  regardlessoftheiroccupational  title.  In  addition,  Defense 
plans  to  update  strategies  forgaps  identified  in  two  mission- 
critical  IT  occupations  after  it  reviews  data  from  more  recent 
com  petency  assessments  planned  for  the  summer  of  201 6. 
However,  the  departmenthas  notyet  developed  gap  mitigation 
strategies  forpersonnel  in  its  third  mission-critical  occupation 
and  14  other  occupations  because  it  has  notyet  determined  their 
competencygaps. 

Implementactivities  thataddress  gaps 
(including  IT  acquisition  cadres, 
cross-functional  training  of  acquisition 
and  program  personnel,  career  paths 
for  program  managers,  plans  to 
strengthen  program  management,  and 
use  of  special  hiring  authorities) 

Partially 

implemented 

Defense  has  partiallyimplemented  activities  thataddress  gaps. 
For  example,  the  departmentimplemented  plans  to  address 
staffing  gaps  identified  in  its  Strategic  Workforce  Plan  for  fiscal 
years  201 3-201 8.  The  department  has  also  established  an  IT 
acquisition  cadre  bydefining  staff  who  have  IT  acquisition 
responsibilitiesand  byestablishing  an  integrated  team  thatis  to 
review,  modify,  and  make  recommendations  on  the  department’s 
IT  acquisition  careerfield;  provided  cross-functional  training  of  IT 
acquisition  and  program  personnel  through  courses  offered  by 
the  Defense  Acquisition  University;  updated  course  offerings  that 
are  intended  to  strengthen  program  management;  and  utilized 
special  hiring  authorities  to  fill  IT  acquisition  staffing  vacancies. 
However,  Defense  has  notyet  determined  competencygaps  that 
need  to  be  addressed  for  IT  personnel  in  one  of  its  three 
miss  ion-critical  occupations  and  14  other  occupations.  In 
addition,  Defense  has  notestablished  a  career  path  for  IT 
program  managers. 

Page  52 


GAO-17-8  IT  Workforce 


Key  steps  and  activities 

Rating 

Description 

Monitor  and  report  progress  in  addressing  IT 
skill  gaps 

Monitor  the  agency’s  progress  in 
addressing  competencyand  staffing 
gaps 

Partially 

implemented 

Defense  has  partially  monitored  progress  in  implementing  its  IT 
workforce  developmentstrategies,  including  addressing  staffing 
gaps  and  broadertransformation  efforts  through  its  Strategic 
Workforce  Plan  for  fiscal  years  2014-2019.  However,  the 
departmenthas  notyet  demonstrated  thatit  is  monitoring  the 
implementation  of  strategies  to  address  gaps  in  two  of  its  three 
mission-critical  IT  occupations.  In  addition,  the  departmenthas 
not  yet  assessed  gaps  or  developed  gap  mitigation  strategies  for 
IT  personnel  in  its  third  mission-critical  occupation  and  Mother 
occupations. 

Reportto  agencyleadershipon 
progress  in  addressing  competencyand 
staffing  gaps 

Partially 

implemented 

Defense  has  reported  progresstodepartmentleadership  in 
addressing  staffing  gaps  and  broadertransformation  efforts 
through  its  Strategic  Workforce  Plans  for  fiscal  years  2013-2018 
and  fiscal  years  201 4-201 9.  However,  these  reports  have  notyet 
included  progress  updates  on  efforts  to  address  IT  competency 
gaps. 

Source:  GAO  analysis  of  Defense  data.  |  GAO- 17-8 


To  its  credit,  Defense  has  established  competency  models,  conducted 
gap  assessments,  and  is  developing  strategies  for  two  of  its  three  major 
IT  occupations  and  officials  reported  that  the  department  is  working  on 
revalidating  competencies  for  its  third  major  IT  occupation  by  fiscal  year 
2016.  According  to  department  workforce  data  from  March  2015,  these 
three  occupations  comprised  approximately  93  percent  of  its  IT 
workforce.  However,  Defense  has  not  yet  established  competency 
models  and  conducted  gap  assessments  for  the  remaining  15  IT 
occupations  because  it  has  focused  initially  on  developing  competencies 
and  assessing  gaps  for  its  mission-critical  IT  occupations  after  developing 
a  tool  in  2014  that  it  could  use  in  performing  such  enterprise 
assessments.  Further,  officials  from  Defense’s  Office  of  the  CIO  have 
recognized  limitations  with  assessing  IT  skill  gaps  solely  based  on 
existing  occupational  titles  and  position  descriptions.  As  a  result,  the 
department  is  in  the  process  of  implementing  strategies  and  plans  to 
establish  a  set  of  work  roles  and  a  baseline  set  of  knowledge,  skills,  and 
abilities  that  apply  to  personnel  spread  across  a  number  of  functional 
communities  who  perform  significant  cybersecurity,  IT,  and  other 
cyber-related  roles.  According  to  Defense’s  Strategic  Workforce  Plan  for 
fiscal  years  2014  through  2019,  the  department  anticipates  that  this  effort 
will  help  in  monitoring  the  overall  health  and  capability  of  the  workforce  at 
a  granular  level  not  previously  attainable. 

By  not  fully  implementing  key  IT  workforce  planning  activities,  Defense 
runs  the  risk  that  it  cannot  adequately  assess  and  address  gaps  in 
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knowledge  and  skills  that  are  critical  to  providing  support  for  major 
acquisitions.  As  a  result,  Defense  may  have  difficulty  in  anticipating  and 
responding  to  evolving  staffing  needs  while  developing,  implementing, 
and  operating  critical  IT  systems. 

HHS 

The  Department  of  Health  and  Human  Services  (HHS)  has  begun 
building  its  capability  to  set  the  strategic  direction  for  its  IT  workforce  by 
taking  foundational  steps  towards  establishing  a  workforce  planning 
process.  Of  the  eight  activities  needed  to  perform  workforce  planning, 

HHS  partially  implemented  six  and  did  not  implement  two.  Table  4 
identifies  the  extent  to  which  HHS  implemented  key  IT  workforce  planning 
steps  and  activities. 

Table  4:  Evaluation  of  the  Department  of  Health  and  Human  Services’  (HHS)  Implementation  of  Key  Information  Technology 
(IT)  Workforce  Planning  Steps  and  Activities 

Key  steps  and  activities 

Rating  Description 

Set  the  strategicdirection  for  IT  workforce 
planning 

Establish  and  maintain  a  workforce 
planning  process 

Partially  implemented  HHS  has  partiallyestablished  an  IT  workforce  planning  process. 

The  department  published  a  workforce  strategic  implementation 
plan  in  May  201 6.  The  plan  integrates  IT  and  cybersecurity 
workforce-related  requirements  from  a  wide  variety  of  laws  and 
federal  guidance  into  one  strategic  plan  for  creating  a  workforce 
planning  processatHHS.The  plan  includes  keysteps  for 
establishing  a  workforce  planning  process  to  include  analyzing 
the  workforce,  developing  and  implementing  staff  recruitment 
and  retention  strategies, and  reporting  on  progress.  However, 
im  plementation  of  the  workforce  process  is  still  underwayand 
key  milestones  are  notexpected  to  be  completed  until  fiscal  year 
201 8  or  beyond. 

Develop  com  petencyand  staffing 
requirements 

Partially  implemented  HHS  has  partiallydeveloped  IT  competencyand  staffing 
requirements.  It  has  competencyrequirements  for  its  IT 
workforce,  including  a  set  of  requirements  specificallyfor  its 
cybersecurity  workforce.  However,  while  the  departmenthas 
developed  staffing  requirements  forits  cybersecurity  workforce,  it 
has  not  done  so  for  all  IT  staff. 

Analyze  the  IT  workforce  to  identify  skill 
gaps 

Assess  competencyand  staffing 
needs  regularly 

Partially  implemented  HHS  has  regularlyassessed  competencyneeds  through 

updating  cybersecurityworkforce  requirements,  buthas  not 
regularlyassessed  staffing  needs. 
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Key  steps  and  activities 

Rating 

Description 

Assess  gaps  in  competencies  and 
staffing 

Partially  implemented 

HHS  has  partiallyassessed  gaps  in  competencies  and  staffing. 
HHS’s  acquisition  workforce  assessment  in  fiscal  year 20 14 
identified  three  competencygaps  for  IT  program  managers. 
However,  this  acquisition  workforce  assessmentdid  notinclude 
the  entire  IT  workforce.  HHS  identified  its  top  staffing  gaps  for 
cybersecurity  positions  in  March  201 6.  However,  HHS  has  not 
identified  competencyorstaffing  gaps  forother  segments  of  its 

IT  workforce. 

Develop  strategies  and  implement 
activities  to  address  IT  skill  gaps 

Develop  strategies  and  plans  to 
address  gaps  in  competencies  and 
staffing 

Partially  implemented 

HHS  has  partiallyimplemented  this  activity.  HHS’s  workforce 
developmentstrategic  implementation  plan  identifies  the  need  for 
targeted  strategies  to  address  workforce  issues  and  gaps.  For 
example,  the  plan  identifies  the  need  for  a  strategyto  address 
gaps  in  certifications  for  IT,  cybersecurity,  and  cyber-related 
staff.  While  HHS  has  current  efforts  underway  to  develop 
targeted  workforce  strategies,  ithas  notyet  developed  specific 
plans  forhow  the  departmentis  to  mitigate  gaps  in  competencies 
and  staffing. 

Implementactivities  thataddress 
gaps  (including  IT  acquisition  cadres, 
cross-functional  training  of  acquisition 
and  program  personnel,  career  paths 
for  program  managers,  plans  to 
strengthen  program  management, 
and  use  of  special  hiring  authorities) 

Partially  implemented 

HHS  has  partiallyimplemented  activities  thataddress  gaps.  For 
example,  it  has  provided  cross-functional  training  forits  IT  staff 
through  classroom  training,  rotational  assignments,  and 
mentoring;  taken  steps  to  improve  IT  program  management  by 
developing  a  system  development  lifecycle  process;  developed  a 
careerpath  for  IT  and  cybersecurity  program  managers;and 
utilized  directhiring  authorities  tosupportIT  acquisitions. 
However,  the  departmenthas  notestablished  an  IT  acquisition 
cadre. 

Monitor  and  report  progress  in  addressing 

IT  skill  gaps 

Monitor  the  agency’s  progress  in 
addressing  competencyand  staffing 
gaps 

Not  implemented 

HHS  has  notimplemented  this  activity.  The  departmentdoes  not 
have  gap  mitigation  strategies  or  plans  to  monitorsuch 
strategies. 

Reportto  agency  leadership  on 
progress  in  addressing  competency 
and  staffing  gaps 

Not  implemented 

HHS  has  notimplemented  this  activity.  The  departmentdoes  not 
have  gap  mitigation  strategies  or  plans  to  reporton  such 
strategies. 

Source:  GAO  analysis  of  HHSdata.  |  GAO-17-8 


Several  explanations  exist  for  the  department’s  shortfalls  in  IT  workforce 
planning. 

•  HHS  does  not  have  comprehensive  policies  that  require  the  CIO  to 
implement  key  IT  workforce  planning  activities,  such  as  conducting  IT 
skill  gap  assessments  and  developing  strategies  and  plans  to  address 
those  gaps.  Officials  noted  that  they  have  such  guidance  under 
development. 
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•  HHS  has  not  recently  conducted  skill  gap  assessments  of  its  IT  or 
cybersecurity  workforce  because  it  decided  to  focus  first  on 
establishing  competencies  and  career  paths  for  its  IT  program 
manager  and  cybersecurity  positions.  To  this  end,  department  officials 
have  acknowledged  that  more  comprehensive  IT  workforce  planning 
needs  to  occur  to  address  requirements  of  laws,  such  as  the  Federal 
Cybersecurity  Workforce  Assessment  Act  of  201 5,  and  have  begun 
taking  steps  to  do  so.  In  particular,  HHS  identified  planned  steps  that, 
when  implemented,  could  help  the  department  to  code  and  assess 
skill  gaps  for  its  IT  and  cybersecurity  workforce  at  a  more  granular 
level. 

•  HHS  officials  expressed  concerns  regarding  the  variety  and 
complexity  of  requirements  for  IT  workforce  planning  from  federal 
laws  and  other  guidance.  Officials  noted  that  additional  guidance  from 
OMB  could  help  federal  agencies  avoid  potentially  duplicative  and 
inefficient  implementation  of  the  various  workforce  planning  steps  and 
activities. 

To  its  credit,  HHS  has  recently  taken  positive  steps  to  implement  key  IT 
workforce  planning  activities.  In  June  2015,  the  department  initiated  a 
cybersecurity  workforce  development  program  and  subsequently 
established  competencies  and  career  paths  for  cybersecurity  related 
occupations.  According  to  officials,  HHS  is  currently  working  to  merge  the 
ongoing  cybersecurity  workforce  development  efforts  into  a  broader  IT 
workforce  planning  effort  that  will  allow  the  department  to  conduct  gap 
assessments  and  develop  strategies,  such  as  retention  and  recruitment 
plans,  based  on  a  more  comprehensive  workforce  planning  process. 

Until  HHS  fully  implements  key  IT  workforce  planning  activities, 
management  will  have  a  limited  ability  to  assess  and  address  gaps  in 
knowledge  and  skills  that  are  critical  to  the  success  of  major  acquisitions. 
As  a  result,  it  will  be  difficult  for  HHS  to  anticipate  and  respond  to 
changing  staffing  needs  and  control  human  capital  risks  when  developing, 
implementing,  and  operating  critical  IT  systems. 


Transportation  The  Department  of  Transportation  (Transportation)  is  building  its 

capability  to  assess  IT  skill  gaps,  but  it  currently  does  not  have 
foundational  elements  of  a  workforce  planning  process.  Specifically,  it  has 
partially  implemented  five  activities  and  has  not  implemented  three 
activities.  Table  5  identifies  the  extent  to  which  Transportation 
implemented  key  IT  workforce  planning  steps  and  activities. 
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Table  5:  Evaluation  of  the  Department  of  Transportation’s  (Transportation)  Implementation  of  Key  Information  Technology  (IT) 
Workforce  Planning  Steps  and  Activities 


Key  steps  and  activities 

Rating 

Description 

Set  the  strategicdirectionforIT  workforce 
planning 

Establish  and  maintain  a  workforce 
planning  process 

Not  implemented 

Transportation  has  notestablished  an  IT  workforce  planning 
process.  Office  of  the  chief  information  officerand  human  resource 
officials  stated  the  department  is  in  the  process  of  developing  one, 
although  they  did  notprovide  a  date  for  its  completion. 

Develop  competencyand  staffing 
requirements 

Partially 

implemented 

Transportation  has  partiallydeveloped  IT  competencyand  staffing 
requirements.  It  has  competencyrequirements  forits  IT  workforce 

and  is  in  the  process  of  developing  competency  requirements  for 
its  cybersecurity  workforce.  Further,  it  partially  developed  staffing 
requirements forits  mission-critical  IT workforce  positions, 


including  specific  cybers  ecurity  workforce  positions,  but  it  has  not 
done  so  for  all  positions. 

Analyze  the  IT  workforce  to  identify  skill 
gaps 

Assess  competencyand  staffing  Partially  Transportation  has  partiallyassessed  competencyand  staffing 

needs  regularly  implemented  needs  on  a  regular  basis.  Departmentofficials  reported  thatthey 

assess  staffing  needs  quarterlyfor  majoroccupations  and  provided 
a  recent  example.  However,  the  assessmentdoes  notinclude  all  IT 
staff.  In  addition, thedepartmenthas  notbeen  regularlyreviewing 
competencyneeds  and  only  recently  established  competencies  for 
IT  staff. 

Assess  gaps  in  competencies  and  Partially  Transportation  has  partiallyassessed  gaps  in  IT  competencies  and 

staffing  implemented  staffing. In  June2016,the  departmentassessed competencygaps 

for  its  mission-critical  IT  staff.  The  departmenthas  recently 
assessed  staffing  gaps  for  its  mission-critical,  cybersecurity,  and 
program  manager  positions.  However,  the  mission-critical  staffing 
gapassessmentdid  notcover  all  positions. Also, Transportation’s 
fiscal  year  2014  Acquisition  Human  Capital  Plan  reported  a 
department-wide  shortage  of  certified  program  managementstaff, 
but  officials  were  unable  to  provide  supporting  details  forthis 
finding. 

Develop  strategies  and  implement 
activities  to  address  IT  skill  gaps 


Develop  strategies  and  plans  to 
address  gaps  in  competencies  and 
staffing 

Not  implemented 

Transportation  has  notimplemented  this  activity.  Department 
officials  stated  that  Transportation’s  20 15  Acquisition  Workforce 
Career  Development  Program  includes  strategies  for  improving 
workforce  skills,  butthe  strategies  do  notaddress  specific  IT 
competencyand  staffing  gaps. 

Implementactivities  thataddress 
gaps  (including  IT  acquisition  cadres, 
cross-functional  training  ofacquisition 
and  program  personnel,  career  paths 
for  program  managers,  plans  to 
strengthen  program  management, 
and  use  of  special  hiring  authorities) 

Partially 

implemented 

Transportation  has  partiallyimplemented  activities  thataddress 
gaps. The  departmenthas  updated  guidance  in2014onthe  useof 
earned  value  managementthatwas  intended  to  strengthen 
program  managementon  IT  projects.  However,  Transportation  has 
not  yet  implemented  an  IT  acquisition  cadre,  provided 
cross -functional  training,  developed  a  career  path  for  program 
managers,  orutilized  special  hiring  authorities. 
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Key  steps  and  activities  Rating  Description 

Monitor  and  report  progress  in  addressing 

IT  skill  gaps 

Monitor  the  agency’s  progress  in  Partially  Transportation  has  performed  limited  monitoring  of  activities  to 

addressing  competency  and  staffing  implemented  address  IT  ski  II  gaps.  Specifically,  Transportation  monitors  whether 

gaps  program  managers  are  certified  for  major  IT  investments.  This 

information  is  reported  to  the  Office  of  Managementand  Budgeton 
a  monthlybasis.  However, the  departmentis  notmonitoring 
strategies  and  plans  toaddressgaps  in  IT  competencies  and 
staffing  because  ithas  not  developed  such  plans. 

Report  to  agency  leadership  on  Not  implemented  Transportation  has  not  performed  this  activity  because  ithas  not 

progress  in  addressing  competency  developed  gap  m  itigation  plans  on  which  to  report  progress, 

and  staffing  gaps 

Source:  GAO  analysis  of  Transportation  data.  |  GAO- 17-8 

Transportation  officials  provided  explanations  for  the  department’s 
shortfalls  in  IT  workforce  planning.  For  example,  the  department  has  only 
recently  established  policies  to  guide  its  workforce  planning  activities.  In 
addition,  the  department  did  not  consider  hiring  staff  to  ensure  that 
program  managers  were  certified  to  be  a  priority. 

To  its  credit,  Transportation  has  plans  to  improve  its  IT  workforce.  For 
example,  the  department  is  planning  to  (1)  develop  plans  by  the  end  of 
fiscal  year  2016  that  could  lead  to  the  creation  of  an  IT  acquisition  cadre 
and  use  of  direct  hiring  authority,  (2)  draft  an  approach  for 
cross-functional  training  of  IT  acquisition  and  program  personnel,  and  (3) 
develop  a  career  path  for  program  managers  by  fiscal  year  2017.  While 
these  are  positive  steps,  these  actions  are  not  yet  rooted  in  an  IT 
workforce  planning  process  that  lays  the  foundation  for  how  the 
department  is  to  analyze  its  IT  workforce  skill  gaps,  develop  and 
implement  strategies  to  address  gaps,  and  monitor  and  evaluate  progress 
in  addressing  the  gaps. 

By  not  fully  implementing  key  IT  workforce  planning  activities, 
Transportation  has  a  limited  ability  to  assess  and  address  gaps  in 
knowledge  and  skills  that  are  critical  to  the  success  of  major  acquisitions. 
As  a  result,  it  will  be  difficult  to  anticipate  and  respond  to  changing  staffing 
needs  and  control  human  capital  risks  when  developing,  implementing, 
and  operating  critical  IT  systems. 


Treasury  The  Department  of  the  Treasury  (Treasury)  has  taken  steps  to  improve  its 

IT  and  program  management  workforce  by  partially  implementing  seven 
activities;  however,  the  department  has  not  yet  implemented  one  key 
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workforce  planning  activity.  Table  6  identifies  the  extent  to  which  Treasury 
has  implemented  key  IT  workforce  planning  steps  and  activities. 

Table  6:  Evaluation  of  the  Department  of  the  Treasury’s  (Treasury)  Implementation  of  Key  Information  Technology  (IT) 
Workforce  Planning  Steps  and  Activities 

Key  steps  and  activities 

Rating 

Description 

Set  the  strategicdirection  for  IT 
workforce  planning 

Establish  and  maintain  a  workforce 
planning  process 

Not  implemented 

Treasury  has  notimplemented  this  activity.  While  the  departmenthas 
a  strategicworkforce  planning  model,  ithas  deferred  applying  the 
model  on  the  IT  workforce  pending  a  review  of  a  workforce 
assessmenttool  being  piloted  within  the  Internal  Revenue  Service. 

Develop  com  petencyand  staffing 

Partially 

Treasury  has  partiallydeveloped  competencyand  staffing 

requirements 

implemented 

requirements.  It  has  identified  staffing  requirements forits  sole 
mission-critical  IT  occupation  and  has  defined  competencies  for  IT 
program  managers.  However,  Treasury  has  not  defined  targets  for 
staff  in  at  leastsixotheroccupations  that  contribute  to  its  cyber 
efforts  or  established  competency  requirements  thatcover  its  entire 

IT  workforce. 

Analyze  the  IT  workforce  to  identify  skill 
gaps 

Assess  competencyand  staffing 

Partially 

Treasury  has  partiallyassessed  competencyand  staffing  needs  on  a 

needs  regularly 

implemented 

regular  basis.  Departmentofficials  stated  thatthey  review  staffing 
needs  forIT  staff  annuallyand  provided  examples  from  fiscal  years 

201 4  and  201 5  for  the  department’s  mission-critical  IT  occupation. 
However,  the  departmenthas  notregularlyassessed  staffing  needs 
for  other  occupations  orestablished  competency  requirements  forits 
entire  IT  workforce  from  which  to  assess  competency  needs. 

Assess  gaps  in  competencies  and 

Partially 

Treasury  has  partiallyassessed  gaps  in  competencies  and  staffing.  It 

staffing 

implemented 

identified  staffing  gaps  forIT  positions,  including  its  mission-critical 
occupation  and  cybersecurity-specific  positions.  Treasury  has 
assessed  competencygaps  within  one  branch  ofthe  office  of  the 
chief  information  officerin  2012,  identified  cybersecurity  competency 
gaps  within  two  bureaus  and  the  office  ofthe  chief  information  officer 
in  fiscal  year  201 5,  and  is  pilotingan  IT  competencysetand 
assessmenttool  within  the  Internal  Revenue  Service.  In  addition, 
Treasury  is  measuring  gaps  in  IT  program  managercompetencies 
based  on  certification  rates.  However,  it  has  notyet  established 
competencyrequirementsforits  entire  IT  workforce  from  which  to 
analyze  competencygaps  across  the  department.  Further,  Treasury 
identified  that  there  are  at  least  six  additional  occupations  that 
contribute  to  the  department’s  cyberefforts,  but  the  departmenthas 
not  identified  staffing  targets  or  competency  requirements  thatwould 
facilitate  gap  assessments  for  these  staff. 
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Key  steps  and  activities 

Rating 

Description 

Develop  strategies  and  implement 
activities  to  address  IT  skill  gaps 

Develop  strategies  and  plans  to 
address  gaps  in  competencies  and 
staffing 

Partially 

implemented 

Treasury  has  partiallydeveloped  strategies  and  plans  to  address 
gaps  in  competenciesand  staffing. Two  out  of  10  bureaus  developed 
action  plans  in  fiscal  year  2015  to  address  cybersecuritystaffing  and 
com  petencygaps.  However,  Treasury  did  not  define  staffing  targets 
or  competency  requirements  for  other  bureaus  or  other  segments  of 
its  IT  workforce  from  which  to  assess  gaps  or  develop  strategies  for 
addressing  gaps. 

Implementactivities  thataddress 
gaps  (including  IT  acquisition 
cadres,  cross-functional  training  of 
acquisition  and  program  personnel, 
career  paths  for  program 
managers,  plans  to  strengthen 
program  management,  and  use  of 
special  hiring  authorities) 

Partially 

implemented 

The  departmenthas  partiallyimplemented  activities  thataddress 
gaps.  It  has  established  an  IT  acquisition  cadre  through  an 
acquisition  integrated  projectteam  within  the  office  of  the  chief 
information  officer,  provided  cross-functional  training  ofacquisition 
and  program  personnel,  and  taken  steps  to  strengthen  program 
managementthrough  establishing  certification  and  training  policies 
for  individuals  managing  major  IT  investments.  However,  it  has  not 
developed  a  career  path  for  program  managers  or  used  special  hiring 
authorities  for  IT  acquisition  positions. 

Monitor  and  reportprogress  in 
addressing  IT s kil  1  gaps 

Monitor  the  agency’s  progress  in 
addressing  competencyand 
staffing  gaps 

Partially 

implemented 

Treasury  is  monitoring  the  status  ofstaffing  gaps  within  the  office  of 
the  chief  information  officerthrough  a  hiring  dashboard.  However,  the 
departmenthas  not  monitored  progress  of  action  plans  to  address 
cybersecurity  skill  gaps  attwo  bureaus  and  the  office  of  the  chief 
information  officer.  Moreover,  it  did  not  identify  specific  gaps  forother 
segments  ofthe  IT  workforce  from  which  to  develop  strategies  and 
monitor  their  progress. 

Reportto  agency  leadership  on 
progress  in  addressing  competency 
and  staffing  gaps 

Partially 

implemented 

Treasury  has  partiallyreported  progress  todepartmentleadership  in 
addressing  competencyand  staffing  gaps.  In  quarterly  performance 
reviews  in  January2016and  May  201 6  and  a  data-driven 
management  review  in  June  201 6,  Treasury  reported  to  senior 
departmentleaders  and  OMB  on  its  cybersecurity  staffing  gaps  and 
on  efforts  to  address  the  gaps  through  a  pilotcybersecurity 
recruitmentand  retention  program.  However,  the  departmentdid  not 
identify  specific  gaps  forother  segments  ofthe  IT  workforce  from 
which  to  develop  strategies  and  reporton  their  progress. 

Source:  GAO  analysis  of  Treasury  data.  |  GAO- 17-8 


According  to  Treasury’s  March  2016  FITARA  Common  Baseline 
Implementation  Plan,  the  department  is  working  to  develop  plans  and 
processes  by  which  the  CIO,  chief  human  capital  officer,  and  senior 
procurement  executive  will  develop  a  common  set  of  competency 
requirements  for  IT  staff  and  a  workforce  planning  process.  Treasury  has 
a  policy  for  utilizing  a  department-wide  strategic  workforce  planning 
model.  However,  the  department  has  deferred  the  use  of  this  model  on 
the  IT  workforce  until  the  results  of  an  Internal  Revenue  Service  IT 
workforce  assessment  pilot  are  available  and  have  been  reviewed  by  the 
CIO  and  chief  human  capital  officer.  Treasury’s  FITARA  Common 
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Baseline  Implementation  Plan  noted  that  the  timing  of  these  steps  is 
difficult  to  estimate  because  each  decision  point  depends  on  the  outcome 
of  the  preceding  step  and  because  staff  and  managers  would  need  to 
coordinate  workforce  planning  with  other  time  demands.  According  to  its 
implementation  plan,  among  other  milestones,  the  chief  human  capital 
officer  is  to  provide  a  recommendation  to  the  CIO  for  a  process  and  tools 
to  conduct  a  competency-based  workforce  planning  study  of  the  Treasury 
IT  workforce  in  fiscal  year  2017. 

While  Treasury’s  plans  are  a  good  starting  point,  it  is  too  soon  to  tell 
whether  these  plans  will  address  the  shortcomings  we  identified.  By  not 
fully  implementing  key  IT  workforce  planning  activities,  Treasury  has  a 
limited  ability  to  assess  and  address  gaps  in  knowledge  and  skills  that  are 
critical  to  the  success  of  major  acquisitions.  Until  the  department 
addresses  the  shortcomings  in  its  IT  workforce  planning  activities,  it  will 
be  more  difficult  to  anticipate  and  respond  to  changing  staffing  needs  and 
control  human  capital  risks  when  developing,  implementing,  and 
operating  critical  IT  systems. 


Conclusions 


Agencies  can  improve  the  success  of  their  IPTs  for  IT  acquisitions 
through  effective  executive  leadership  that  emphasizes  team  support, 
empowerment,  and  oversight;  effective  team  composition;  and  effective 
processes  for  team  operations.  When  implemented,  these  key  practices 
can  better  position  agencies  to  efficiently  make  decisions  that  cross  lines 
of  expertise. 

The  right  mix  of  expertise  to  recognize  problems  early  and  the  requisite 
authority  to  do  something  about  them  are  contingent  upon  effective  IT 
workforce  planning.  While  the  five  selected  departments  have 
demonstrated  progress  by  implementing  key  IT  workforce  planning 
activities,  each  had  shortfalls.  To  their  credit,  all  five  had  at  least  partially 
analyzed  their  IT  workforce  and  implemented  certain  activities  to  enhance 
workforce  skills.  In  addition,  several  departments  identified  promising 
activities  that,  when  implemented,  could  bolster  effectiveness  in 
assessing  and  addressing  IT  skill  gaps.  For  example,  Defense  and  HHS 
have  initiated  efforts  to  assess  the  IT  and  cybersecurity  workforce  at  a 
more  granular  level  and  the  Internal  Revenue  Service  within  Treasury  is 
piloting  a  workforce  assessment  tool  that  may  help  the  department 
assess  its  skill  gaps.  However,  only  Defense  demonstrated  that  it  had 
implemented  a  workforce  planning  process.  Further,  none  of  the 
departments  identified  IT  competency  gaps  for  their  entire  workforce,  and 
only  three  were  performing  some  level  of  monitoring  towards  the  closure 
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of  identified  skill  gaps.  Until  departments  fully  implement  the  key  activities 
and  steps,  they  will  have  a  limited  ability  to  assess  and  address  gaps  in 
knowledge  and  skills  that  are  critical  to  the  success  of  major  IT 
acquisitions. 


Rprnmmpnrtatinnc;  fnr  facilitate  the  analysis  of  gaps  between  current  skills  and  future  needs, 
iacoui  ici  iucuiui  is>  IUI  the  development  of  strategies  for  filling  the  gaps,  and  succession 

Executive  Action  planning,  we  are  making  a  total  of  five  recommendations  to  the 

Secretaries  of  Commerce,  Defense,  Health  and  Human  Services, 
Transportation,  and  the  Treasury. 

We  are  making  one  recommendation  to  the  Secretary  of  Commerce  to 
require  the  Chief  Information  Officer,  Chief  Human  Capital  Officer,  and 
other  senior  managers  as  appropriate  to  address  the  shortfalls  in  IT 
workforce  planning  noted  in  this  report,  including  the  following  actions: 

•  establish  and  maintain  a  workforce  planning  process 

•  develop  competency  and  staffing  requirements 

•  assess  competency  and  staffing  needs  regularly 

•  assess  gaps  in  competencies  for  all  components  of  the  workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies  and 
staffing 

•  implement  activities  that  address  gaps,  including  an  IT  acquisition 
cadre,  cross-functional  training  of  acquisition  and  program  personnel, 
a  career  path  for  program  managers,  and  special  hiring  authorities,  if 
justified  and  cost-effective 

•  monitor  the  department’s  progress  in  addressing  IT  competency  and 
staffing  gaps 

•  report  to  department  leadership  on  progress  in  addressing 
competency  and  staffing  gaps 

We  are  making  one  recommendation  to  the  Secretary  of  Defense  to 
require  the  Chief  Information  Officer,  the  Under  Secretary  of  Defense  for 
Personnel  and  Readiness,  and  other  senior  managers  as  appropriate  to 
address  the  shortfalls  in  IT  workforce  planning  noted  in  this  report, 
including  the  following  actions: 

•  develop  competencies  for  all  staff 

•  assess  competency  needs  regularly  for  all  positions 

•  assess  gaps  in  competencies  for  all  components  of  the  workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies 
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•  implement  activities  that  address  gaps,  including  developing  a 
program  management  career  path,  if  justified  and  cost-effective 

•  monitor  the  department’s  progress  in  addressing  competency  gaps 
identified  for  IT  staff 

•  report  to  department  leadership  on  progress  in  addressing 
competency  gaps 

We  are  making  one  recommendation  to  the  Secretary  of  Health  and 
Human  Services  to  require  the  Chief  Information  Officer,  Chief  Human 
Capital  Officer,  and  other  senior  managers  as  appropriate  to  address  the 
shortfalls  in  IT  workforce  planning  noted  in  this  report,  including  the 
following  actions: 

•  establish  and  maintain  a  workforce  planning  process  inclusive  of  all 
staff 

•  develop  staffing  requirements  for  all  positions 

•  assess  staffing  needs  regularly 

•  assess  gaps  in  competencies  and  staffing  for  all  components  of  the 
workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies  and 
staffing 

•  implement  activities  that  address  gaps,  including  an  IT  acquisition 
cadre,  if  justified  and  cost-effective 

•  monitor  the  department’s  progress  in  addressing  competency  and 
staffing  gaps 

•  report  to  department  leadership  on  progress  in  addressing 
competency  and  staffing  gaps 

We  are  making  one  recommendation  to  the  Secretary  of  Transportation  to 
require  the  Chief  Information  Officer,  Chief  Human  Capital  Officer,  and 
other  senior  managers  as  appropriate  to  address  the  shortfalls  in  IT 
workforce  planning  noted  in  this  report,  including  the  following  actions: 

•  establish  a  time  frame  for  when  the  department  is  to  finalize  its  draft 
workforce  planning  process  and  maintain  that  process 

•  develop  staffing  requirements  for  all  positions 

•  assess  competency  and  staffing  needs  regularly  for  all  positions 

•  assess  gaps  in  staffing  for  all  components  of  the  workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies  and 
staffing 

•  implement  activities  that  address  gaps,  including  an  IT  acquisition 
cadre,  cross-functional  training  of  acquisition  and  program  personnel, 
a  career  path  for  program  managers,  and  use  of  special  hiring 
authorities,  if  justified  and  cost-effective 
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•  monitor  the  department’s  progress  in  addressing  competency  and 
staffing  gaps 

•  report  to  department  leadership  on  progress  in  addressing 
competency  and  staffing  gaps 

We  are  making  one  recommendation  to  the  Secretary  of  the  Treasury  to 
require  the  Chief  Information  Officer,  Chief  Human  Capital  Officer,  and 
other  senior  managers  as  appropriate  to  address  the  shortfalls  in  IT 
workforce  planning  noted  in  this  report,  including  the  following  actions: 

•  establish  and  maintain  a  workforce  planning  process 

•  develop  competency  and  staffing  requirements  for  all  positions 

•  assess  competency  and  staffing  needs  regularly 

•  assess  gaps  in  competencies  and  staffing  for  all  components  of  the 
workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies  and 
staffing  for  all  components  of  the  workforce 

•  implement  activities  that  address  gaps,  including  a  career  path  for 
program  managers  and  special  hiring  authorities,  if  justified  and  cost- 
effective 

•  monitor  the  department’s  progress  in  addressing  competency  and 
staffing  gaps 

•  report  to  department  leadership  on  progress  in  addressing 
competency  and  staffing  gaps  for  all  components  of  the  workforce 


Agency  Comments 
and  Our  Evaluation 


We  received  comments  on  a  draft  of  this  report  from  the  five  departments 
to  which  we  made  recommendations — Commerce,  Defense,  Health  and 
Human  Services,  Transportation,  and  the  Treasury.  Of  those  five 
departments,  four  agreed  with  our  recommendations  and  one,  Defense, 
partially  agreed.  The  following  summarizes  each  department’s  comments. 

•  In  written  comments,  Commerce  agreed  with  our  recommendation 
and  stated  that  it  will  work  to  develop  an  action  plan  to  address  the 
key  workforce  planning  steps  and  activities  identified  in  this  report. 

The  department’s  comments  are  reprinted  in  appendix  II. 

•  In  its  written  comments,  Defense  partially  agreed  with  our 
recommendation  and  discussed  its  progress  on  selected  activities.  In 
commenting  on  the  activity  involving  the  development  of  strategies 
and  plans  to  address  gaps  in  competencies  and  staffing  (activity  5), 
the  department  stated  that  it  had  provided  additional  information  on  its 
related  efforts  in  its  Strategic  Workforce  Plan  for  fiscal  years  2016 
through  2021.  However,  the  department  did  not  attach  a  copy  of  the 
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workforce  plan.  Moreover,  the  workforce  plan,  as  described,  does  not 
cover  staffing  gaps  or  address  Defense’s  entire  IT  workforce. 

In  addition  to  its  workforce  planning  strategies,  the  department 
commented  on  its  efforts  to  develop  competencies,  as  part  of  the 
activity  to  establish  requirements  for  competencies  and  staffing 
(activity  2).  The  department  stated  that  it  has  established 
competencies  for  the  Information  Technology  Management  and 
Computer  Science  series  and  is  scheduled  to  complete  competencies 
for  the  Telecommunications  series,  its  third  and  final  mission-critical  IT 
occupation,  by  the  end  of  December  201 6.  The  department  further 
stated  that,  in  addition  to  its  three  mission-critical  occupations,  it  has 
developed  competencies  for  its  next  largest  IT  occupation,  Computer 
Clerk  and  Assistant  (series  0335).  This  is  to  result  in  a  total  of  95 
percent  of  workforce  competencies  developed  or  to  be  developed  by 
the  end  of  December  201 6. 

Nevertheless,  while  establishing  competencies  is  an  important  step 
toward  robust  IT  workforce  planning,  it  remains  important  for  Defense 
to  also  identify  how  it  intends  to  complete  the  workforce  planning 
cycle  for  staff  represented  by  each  of  the  occupations  for  which  it  has 
developed  or  plans  to  develop  competencies.  Assessing  competency 
gaps  and  developing  gap  mitigation  strategies  are  important  next 
steps. 

Looking  across  all  of  the  activities,  the  department  further  stated  that, 
in  addition  to  the  four  occupations  comprising  95  percent  of  the  IT 
workforce,  half  of  the  department’s  remaining  14  IT  occupations  are 
filled  with  less  than  100  staff,  and  that  several  of  the  remaining 
occupations  are  likely  to  experience  attrition.  The  department  added 
that  it  does  not  believe  it  is  necessary  to  develop  competencies, 
identify  competency  gaps,  and  develop  gap  closure  strategies  for  the 
remaining  5  percent  of  its  IT  workforce,  as  these  individuals  would 
likely  not  have  a  role  on  integrated  program  teams  or  be  in  a  position 
critical  to  the  success  of  major  IT  acquisitions. 

We  understand  the  importance  of  Defense  prioritizing  its  efforts  to 
focus  on  the  95  percent  of  its  workforce  that  are  likely  to  have  a  role 
on  integrated  program  teams  or  be  in  a  position  critical  to  the  success 
of  major  IT  acquisitions.  However,  identifying  gaps  and  developing 
strategies  for  the  remaining  5  percent  of  its  IT  workforce  will  become 
more  relevant  as  the  department  begins  its  transition  to  focus  on  work 
roles  and  knowledge,  skills,  and  abilities  rather  than  occupations. 
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Therefore,  we  maintain  that  our  recommendation  is  warranted.  The 
department’s  comments  are  reprinted  in  appendix  III. 

•  HHS  also  provided  written  comments,  in  which  the  department  agreed 
with  our  recommendation  and  identified  several  planned  or  ongoing 
actions  to  address  it.  The  department  stated  that  it  is  growing  its 
capability  for  mature  workforce  analytics  and  planning,  in  part,  through 
the  identification  and  definition  of  critical  IT  and  cybersecurity  role 
categories  and  competency  requirements.  The  department  also  noted 
that  it  plans  to  utilize  codes  from  OPM  and  the  National  Institute  of 
Standards  and  Technology  in  its  efforts  to  assess  skill  gaps  and 
staffing  needs.  In  addition,  HHS  provided  new  documentation  of  its 
completion  of  an  IT  program  manager  career  path.  We  modified  our 
assessment  and  corresponding  recommendation  for  the  relevant 
activity  (activity  6)  to  reflect  these  efforts.  The  department’s  comments 
are  reprinted  in  appendix  IV. 

•  In  written  comments,  Transportation  agreed  with  our  recommendation 
and  described  planned  actions  to  address  it.  Specifically,  the 
department  stated  that  it  is  leveraging  its  Strategic  Workforce 
Planning  Guide  to  navigate  its  efforts  in  assessing  IT  skill  gaps  and 
enhancing  workforce  proficiency.  The  department  also  noted  that 
actions  underway  include  finalizing  plans  for  creating  IT  acquisition 
cadres  and  using  direct  hiring  authority,  developing  an  approach  for 
cross-functional  training  of  IT  acquisition  and  program  management 
personnel,  and  collaborating  across  departmental  offices  on  the 
development  of  an  IT  program  manager  career  path.  Transportation’s 
comments  are  reprinted  in  appendix  V. 

•  In  its  written  comments,  Treasury  agreed  with  our  recommendation 
and  identified  planned  and  ongoing  efforts  to  address  it.  Specifically, 
the  department  noted  that,  while  an  agency-wide  assessment  of  the 
IT  workforce  has  not  yet  been  completed,  several  component 
bureaus — including  the  Internal  Revenue  Service,  which  comprises 
over  80  percent  of  the  total  Treasury  IT  workforce — have  been 
assessing  their  workforce.  In  addition,  the  department  stated  that  its 
FITARA  Implementation  Plan  identifies  intended  steps  for  meeting  the 
requirements  established  by  Congress  and  OMB,  including  IT 
workforce  management,  and  that  it  is  on  track  to  establish  a  more 
robust  workforce  planning  capability  by  the  end  of  fiscal  year  2017. 
Treasury’s  written  comments  are  reprinted  in  appendix  VI. 

In  addition  to  its  written  comments  on  the  recommendations,  the 
department  also  provided  emails  containing  its  comments  on  selected 
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findings  in  the  draft  report,  which  we  addressed  as  appropriate. 

Specifically: 

•  Treasury  stated  that  it  did  not  agree  with  our  assessment  that  the 
department  has  not  implemented  the  key  IT  workforce  planning 
activity  to  establish  and  maintain  a  workforce  planning  process 
(activity  1).  However,  the  department’s  efforts  have  not  been 
sufficient  to  justify  a  higher  rating  for  this  activity.  As  noted  in  the 
report,  while  the  department  has  a  strategic  workforce  planning 
model,  it  has  deferred  applying  the  model  to  the  IT  workforce 
pending  a  review  of  a  workforce  assessment  tool  being  piloted 
within  the  Internal  Revenue  Service.  We  do  not  consider  this 
situation  to  reflect  an  established  and  maintained  IT  workforce 
planning  process  because  the  pilot  has  not  been  completed  and 
reviewed  by  the  CIO  and  chief  human  capital  officer,  which  was 
identified  as  a  foundational  step  in  its  FITARA  implementation 
plan.  Further,  decisions  are  yet  to  be  made  regarding  (1)  which  IT 
workforce  planning  approach  the  department  will  utilize:  the 
process  still  being  piloted  at  the  Internal  Revenue  Service,  the 
department’s  existing  strategic  workforce  planning  model  that 
does  not  specifically  address  how  IT  components  are  to  be 
assessed,  ora  hybrid  approach;  and  (2)  how  and  when  its 
selected  approach  will  be  applied  to  assess  skill  gaps  for  the 
department’s  IT  workforce. 

•  Treasury  also  stated  that  we  did  not  give  the  department  credit  for 
a  cybersecurity  skill  gap  assessment  that  it  performed,  which 
relates  to  the  key  IT  workforce  planning  activity  to  assess  gaps  in 
competencies  and  staffing  (activity  4).  We  disagree.  We  noted  in 
the  report  that  Treasury  had  identified  staffing  gaps  for  IT 
positions,  including  its  mission-critical  occupation  and 
cybersecurity  specific  positions.  This  was  based  in  part  on  the 
cybersecurity  staffing  gap  assessment  that  the  department 
performed,  which  factored  into  our  rating  of  “partially 
implemented”  for  this  activity. 

•  The  department  did  not  agree  with  our  assessment  that  it  had  not 
implemented  the  key  IT  workforce  planning  activity  to  report  to 
agency  leadership  on  progress  in  addressing  competency  and 
staffing  gaps  (activity  8).  After  evaluating  reports  to  senior 
department  leaders  and  OMB  regarding  its  cybersecurity  staffing 
gaps  and  efforts  to  address  the  gaps  through  a  pilot  cybersecurity 
recruitment  and  retention  program — which  the  department 
provided  with  its  comments — we  changed  our  rating  from  “not 
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implemented”  to  “partially  implemented”  and  revised  the 
description  for  this  activity. 

In  addition  to  the  aforementioned  departments,  we  sought  comments 
from  other  federal  agencies,  including  GSA,  OMB,  OPM,  and  VA.  We 
received  e-mails  from  GSA,  OMB,  and  OPM  stating  that  they  had  no 
comments  on  the  report.  We  also  received  an  e-mail  from  VA  with  a 
technical  comment  that  we  addressed  as  appropriate. 


We  are  sending  copies  of  this  report  to  interested  congressional 
committees,  the  Secretary  of  Commerce,  the  Secretary  of  Defense,  the 
Secretary  of  Health  and  Human  Services,  the  Secretary  of 
Transportation,  the  Secretary  of  the  Treasury,  the  Director  of  the  Office  of 
Personnel  Management,  and  the  Director  of  the  Office  of  Management 
and  Budget,  and  other  interested  parties.  In  addition,  this  report  will  be 
available  on  the  GAO  Website  at  http://www.gao.gov. 

If  you  or  your  staffs  have  any  questions  on  the  matters  discussed  in  this 
report,  please  contact  me  at  (202)  512-9286  or  at  pownerd@gao.gov. 
Contact  points  for  our  Offices  of  Congressional  Relations  and  Public 
Affairs  maybe  found  on  the  last  page  of  this  report.  GAO  staff  who  made 
major  contributions  to  this  report  are  listed  in  appendix  VII. 


David  A.  Powner 
Director,  Information  Technology 
Management  Issues 
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Our  objectives  were  to  (1)  identify  key  characteristics  of  a  comprehensive 
integrated  program  team  (IPT)  responsible  for  managing  a  major  federal 
information  technology  (IT)  acquisition,  and  (2)  evaluate  whether  selected 
federal  agencies  are  adequately  assessing  and  addressing  gaps  in 
knowledge  and  skills  that  are  critical  to  the  success  of  major  IT 
acquisitions. 

To  identify  key  characteristics  of  comprehensive  IPTs,  we  listed  over 
1,000  recommended  practices.  In  doing  so,  we  reviewed  approximately 
20  documents  containing  practices  applicable  to  IPTs  that  were 
recommended  by  government  and  industry  organizations,  including: 

•  Department  of  Defense,  Office  of  the  Under  Secretary  of  Defense 
(Acquisition  and  Technology),  DoD  Integrated  Product  and  Process 
Development  Handbook,  August  1998; 

•  American  Council  for  Technology- Industry  Advisory  Council,  Key 
Success  Factors  for  Major  Programs  that  Leverage  IT,  May  2014; 

•  The  MITRE  Corporation,  Integrated  Project  Team  (IPT)  Start-up 
Guide,  October  2008; 1 

•  Software  Engineering  Institute  at  Carnegie  Mellon  University,  CMMI® 
for  Acquisition,  Version  1.3,  November  2010; 

•  Office  of  Management  and  Budget  (OMB),  25  Point  Implementation 
Plan  to  Reform  Federal  Information  Technology  Management, 
December  2010; 

•  OMB,  Guidance  for  Specialized  Information  Technology  Acquisition 
Cadres,  My  2011; 

•  OMB,  Contracting  Guidance  to  Support  Modular  Development,  June 
2012; 

•  Project  Management  Institute,  Inc.,  A  Guide  to  the  Project 
Management  Body  of  Knowledge  (PMBOK®  Guide),  Fifth  Edition, 


1©2008The  MITRE  Corporation. 
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2013.  PMBOK  is  a  trademark  of  the  Project  Management  Institute, 
Inc.;2 

•  OMB,  Circular  No.  A-11,  Preparation,  Submission,  and  Execution  of 
the  Budget,  Part  7  (Capital  Programming  Guide,  Version  3.0),  June 
2015;  and 

•  OMB,  U.S.  Digital  Services  Play  book. 3 

To  corroborate  and  validate  the  recommended  practices  and  to  identify 
examples  of  how  the  practices  can  be  applied,  we  interviewed  agency 
officials  from  eight  different  organizations:  two  agency  IPTs,  four  offices  of 
the  chief  information  officer  (CIO)  with  oversight  responsibilities  for  IPTs, 
and  two  agencies’  acquisition  centers  of  excellence. 

•  The  two  agency  IPTs  we  interviewed  were  the  Department  of 
Commerce’s  Geostationary  Operational  Environmental  Satellite  -  R 
series  and  the  Department  of  Veterans  Affairs’  Veterans  Benefits 
Management  System.  We  selected  these  two  IPTs  from  a  pool  of  13 
candidates  based  on  the  extent  to  which  they  met  multiple  selection 
criteria  and  did  not  overlap  with  ongoing  GAO  work.  The  selection 
criteria  were:  (a)  suggested  by  OMB  officials  as  being  high-impact 
programs  that  have  had  a  challenging  past  performance  and  have 
current  increased  oversight  from  OMB;  (b)  active  engagement  with 
OMB’s  U.S.  Digital  Service;  (c)  observed  by  OMB  has  having 
relatively  strong  teaming  practices;  (d)  observed  through  the  course  of 
GAO  reviews  as  having  relatively  strong  teaming  practices;  and  (e) 
observed  through  the  course  of  GAO  reviews  as  having  a  history  of 
problems  from  which  lessons  learned  could  be  derived. 

•  The  four  offices  of  the  CIO  we  interviewed  were  from  the  Departments 
of  Commerce,  Defense,  and  Veterans  Affairs.  We  selected 
Commerce,  National  Oceanic  and  Atmospheric  Administration  (within 


2The  sections  ofthe  PMBOK®  Guide  that  we  used  to  support  the  developmentofkey  IPT 
characteristics  were:  1 .3  What  is  Project  Management;  1 .4  Relationships  Among  Portfolio 
Management,  Program  Management,  Project  Management,  and  Organizational  Project 
Management;  2.1  Organizational  Influences  on  Project  Management;  2.2  Project 
Stakeholders  and  Governance;  2.3  Project  Team;  2.4  Project  Life  Cycle;  5.2  Collect 
Requirements;  6.5  Estimate  Activity  Durations;  8  Project  Quality  Management;  9  Project 
Human  Resource  Management;  9.1  Plan  Human  Resource  Management;  9.2  Acquire 
Project  Team;  9.3  Develop  Project  Team;  9.4  Manage  Project  Team;  12  Project 
Procurement  Management;  12.1  Plan  Procurement  Management;  13  Project  Stakeholder 
Management;  and  13.2  Plan  Stakeholder  Management. 

3OMB,  U.S.  D/'g/'fa/ Sern'cesP/aydook (accessed  athttps://playbook.cio.gov/on  Aug.  23, 
2016). 
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the  Department  of  Commerce),  and  Veterans  Affairs  CIO  officials 
because  their  departments  had  oversight  responsibilities  for  the  two 
IPTs  we  interviewed.  We  also  selected  CIO  officials  from  the 
Department  of  Defense  due  to  the  department’s  history  in  adopting 
IPT  concepts.4 

•  The  two  agencies’  acquisition  centers  of  excellence  we  interviewed 
were  the  General  Services  Administration’s  Assisted  Acquisition 
Services  and  the  Department  of  Veterans  Affairs’  Technology 
Acquisition  Center.  We  selected  these  two  centers  of  excellence 
based  on  OMB’s  201 1  guidance  for  agencies  for  formulating 
specialized  IT  acquisition  cadres.5 

•  In  our  interviews,  we  asked  these  officials  to  describe  desirable 
characteristics  of  comprehensive  IPTs,  identify  additional  factors  that 
are  critical  to  the  success  of  IPTs,  and  provide  examples.  We  added 
their  responses  to  our  database  of  IPT  recommended  practices. 

We  conducted  a  content  analysis  on  the  recommended  IPT  practices 
from  our  literature  research  and  from  interviews  with  agency  officials.  In 
doing  so,  team  members  individually  reviewed  the  practices  and  assigned 
them  to  various  categories  and  sub-categories.  Then  the  team  members 
met  to  compare  their  categorization  schemes,  discuss  the  differences, 
and  reach  agreement  on  the  final  overarching  characteristics  and  specific 
sub-practices.  We  validated  the  outcome  of  our  content  analysis  by 
sending  the  results  to  the  agency  IPTs,  CIOs,  and  centers  of  excellence 
which  we  had  interviewed,  as  well  as  two  internal  experts.  We  then 
obtained  their  comments  and  revised  our  final  list  of  IPT  characteristics 
and  practices  as  appropriate.  Finally,  we  created  a  graphic  based  on  the 
total  number  of  times  literature  and  agency  officials  identified  specific 
roles  and  responsibilities.  In  doing  so,  we  incorporated  the  roles  and 
responsibilities  that  were  most  frequently  cited  as  core  disciplines  and 
organized  the  graphic  in  descending  order. 

To  evaluate  whether  selected  federal  agencies  are  adequately  assessing 
and  addressing  gaps  in  knowledge  and  skills  that  are  critical  to  the 
success  of  major  IT  acquisitions,  we  selected  departments  for  our  review, 


According  to  officials  from  Defense’s  Office  of  the  CIO,  officials  from  the  Defense  Office 
of  the  Undersecretary  of  Defense  for  Acquisition,  Technology,  and  Logistics  provided 
inputto  its  responses. 

5OMB,  Guidance  for  Specialized  Information  Technology  Acquisition  Cadres  (Washington, 
D.C.:  July  13,  201 1 ). 
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created  an  evaluation  framework  and  validated  it,  and  assessed  the 
selected  departments’  documents  and  activities  against  the  evaluation 
framework. 

We  selected  the  departments  for  our  review  based  on  a  judgmental  and 
non-generalizable  sample  of  agencies’  data  from  the  Federal  IT 
Dashboard  as  of  August  31, 2015. 6  Specifically,  we  selected  five 
departments — Commerce,  Defense,  Health  and  Fluman  Services, 
Transportation,  and  the  Treasury — based  on  the  following  factors:  (1) 
largest  number  of  major  IT  investments,  (2)  largest  planned  dollar  total  of 
major  IT  spending  in  fiscal  year  2016,  and  (3)  largest  planned  percentage 
of  total  major  IT  spending  with  development,  modernization,  and 
enhancements  in  fiscal  year  2016. 

To  create  the  evaluation  framework,  we  reviewed  relevant  laws  and 
guidance  to  identify  steps  and  activities  for  federal  agencies  to  conduct  IT 
workforce  planning,  including: 

•  Clinger-Cohen  Act  of  1 996 ;6  7 

•  E-Government  Act  of  2002\ 8 

•  Legislation  commonly  referred  to  as  the  Federal  Information 
Technology  Acquisition  Reform  Act,9 

•  Federal  Cybersecurity  Workforce  Assessment  Act  of  201 5; 10 * 12 

•  OMB’s  25  Point  implementation  Plan  to  Reform  Federal  Information 
Technology  Managements 

•  OMB’s  Guidance  for  Specialized  Information  Technology  CadresS 


6https://itdashboard.gov/ (accessed  Aug.  31 , 2015). 

7Pub.  L.  No.  104-106, §  5125(c)(3)(Feb.  10,  1996),  codified  at40U.S.C.  §  1 1 31 5(c)(3). 

8Pub.  L.  No.  107-347, §  209  (Dec.  17,  2002);44  U.S.C.  §  3501  note. 

9Carl  Levin  and  Howard  P.  “Buck”  McKeon  National  Defense  Authorization  Act  for  Fiscal 
Year  201 5,  Div.  A,  Title  VIII,  Subtitle  D — Federal  Information  Technology  Acquisition 
Reform,  Pub.  L.  No.  11 3-291,  §  835  (Dec.  19,  2014);41  U.S.C.  §  1704  note. 

^Federal  Cybersecurity  Workforce  Assessment Actof  201 5,  Pub.  L.  No.  114-113,  Div.  N, 
Title  III  (Dec.  18,2015). 

^OMB,  25  Point  Implementation  Plan  to  Reform  Federal  Information  Technology 
/Wanageme/if(Washington,  D.C.:  Dec.  9,  2010). 

12OMB,  Guidance  for  Specialized  Information  Technology  Acquisition  Cadres 
(Washington,  D.C.:  July  13,  2011). 
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•  O  MB ’s  Managem  ent  and  O  versight  of  Federal  Information 
Technology;''3 

•  OMB’s  Cybersecurity  Strategy  and  Implementation  Plan  for  the 
Federal  Civilian  Government; 14 

•  OMB’s  Federal  Cybersecurity  Workforce  Strategy ;15 

•  OMB’s  Circular  A-1 30,  Managing  Information  as  a  Strategic 
Resource;''6 

•  The  Office  of  Personnel  Management’s  (OPM)  Workforce  Planning 
Model;'7 

•  OPM’s  workforce  planning  guidance  on  key  elements  and  suggested 
performance  indicators;18 

•  OPM’s  IT  Program  Management  Career  Path  Guide; 19  and 

•  GAO  guidance  on  federal  internal  control  standards  as  well  as  key 
principles  for  effective  strategic  workforce  planning.20 

We  developed  a  framework  consisting  of  four  IT  workforce  planning  steps 

and  eight  key  activities,  as  shown  in  table  7. 


13OMB,  Managementand  Oversight  of  Federal  Information  Technology,  Memorandum 
M-15-14  (Washington,  D.C.:  June  10,  2015). 

14OMB,  Cybersecurity  Strategy  and  Implementation  Plan  forthe  Federal  Civilian 
Government,  Memorandum  M-16-04  (Washington,  D.C.:Oct.  30,  2015). 

15OMB,  Federal  Cybersecurity  Workforce  Strategy,  Memorandum  M-1 6-1 5  (Washington, 
D.C.:  July  12,  2016). 

16OMB,  Circular  A-1 30,  Managing  Information  as  a  Strategic  Resource  (Washington,  D.C.: 
July  27,  2016). 

17https://www. opm.gov/policy-data-oversight/human-capital-management/reference-materi 
als/strategic-alignment/workforceplanning.  pdf  (accessed  June  7,2016). 

18https://www. opm.gov/policy-data-oversight/human-capital-management/reference-materi 
als/talent-management/workforceplanning.  pdf  (accessed  June  7,2016). 

19OPM,  IT  Program  Managem  ent  Career  Path  Guide,  Nov.  1 8, 201 1 . 

20GAO,  Human  Capital:  Key  Principles  for  Effective  Strategic  Workforce  Planning, 
GAO-04-39  (Washington,  D.C.:  Dec.  11, 2003)  and  Standards  for  Internal  Control  in  the 
Federal  Government,  GAO-1 4-704G  (Washington,  D.C.:  Sept.  10,2014). 
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Table  7:  Summary  of  Key  Information  Technology  (IT)  Workforce  Planning  Steps 
and  Activities 


Key  workforce  planning  steps  and  activities 

Set  the  strategic  direction  for  I T  workforce  planning 
Establish  and  maintain  a  workforce  planning  process 
Develop  competencyand  staffing  requirements 
Analyze  the  IT  workforce  to  identify  skill  gaps 
Assess  competencyand  staffing  needs  regularly 
Assess  gaps  in  competencies  and  staffing 

Develop  strategies  and  implementactivities  to  address  IT  skill  gaps 
Develop  strategies  and  plans  to  address  gaps  in  competencies  and  staffing 

Implementactivities  thataddress  gaps  (including  IT  acquisition  cadres,  cross-functional 
training  of  acquisition  and  program  personnel,  career  paths  for  program  managers,  plans 
to  strengthen  program  management,  and  use  of  special  hiring  authorities) 

Monitor  and  report  progress  in  addressing  I T  skill  gaps 

Monitorthe  agency’s  progress  in  addressing  competencyand  staffing  gaps 

Report  to  agency  leadership  on  progress  in  addressing  competencyand  staffing  gaps 


Source:  GAO  analysis  of  relevant  laws  and  guidance.  |  GAO- 17-8 

We  validated  the  evaluation  framework  by  soliciting  comments  from 
internal  experts  as  well  as  officials  from  OMB  and  OPM  and  updated  it  as 
appropriate.  We  did  not  perform  a  legal  analysis  as  to  whether  the 
selected  agencies  were  in  actual  compliance  with  the  laws  we  used  to 
derive  our  evaluation  framework. 

We  assessed  the  selected  departments’  documents  and  activities  against 
the  evaluation  framework  by  requesting  relevant  IT  workforce  and  human 
capital  policies,  as  well  as  documentation  from  each  of  its  most  recent  IT 
workforce  competencyand  staffing  gap  assessments.  We  analyzed  the 
policies  and  documents  to  determine  whether  they  were  consistent  with 
the  workforce  planning  steps  and  activities  found  in  our  framework.  The 
documents  we  analyzed  included: 

•  IT  workforce  competencies  and  staffing  requirements, 

•  competency  gap  assessments, 

•  staffing  assessments, 

•  strategic  workforce  plans, 

•  documentation  of  monitoring  progress  in  addressing  IT  workforce  skill 
gaps  and  reporting  to  department  officials, 

•  documentation  regarding  IT  acquisition  cadres, 
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•  documentation  on  cross-functional  training  of  acquisition  and  IT 
personnel, 

•  documentation  regarding  career  paths  for  IT  program  managers, 

•  documentation  of  efforts  to  strengthen  IT  program  management,  and 

•  documentation  of  the  use  of  direct  hire  authority. 

We  also  interviewed  cognizant  officials  at  the  five  departments  to  discuss 
their  policies,  documentation,  and  implementation  of  the  workforce 
planning  steps  and  activities.  Based  on  our  assessment  of  the 
documentation  and  discussion  with  department  officials,  we  assessed  the 
extent  to  which  the  agencies  implemented,  partially  implemented,  or  did 
not  implement  the  steps  and  activities.  We  considered  an  activity  to  be 
fully  implemented  if  a  department  addressed  all  of  the  underlying 
practices  for  the  activity;  partially  implemented  if  it  addressed  some  but 
not  all  of  the  underlying  practices  for  the  activity;  and  not  implemented  if  it 
did  not  address  any  of  the  underlying  practices  for  the  activity. 

We  conducted  this  performance  audit  from  July  2015  to  November  2016 
in  accordance  with  generally  accepted  government  auditing  standards. 
Those  standards  require  that  we  plan  and  perform  the  audit  to  obtain 
sufficient,  appropriate  evidence  to  provide  a  reasonable  basis  for  our 
findings  and  conclusions  based  on  our  audit  objectives.  We  believe  that 
the  evidence  obtained  provides  a  reasonable  basis  for  our  findings  and 
conclusions  based  on  our  audit  objectives. 
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THE  DEPUTY  SECRETARY  OF  COMMERCE 

Washington,  D.C.  20230 


November  3,  2016 


David  A.  Powner 

Director,  Information  Technology  Management  Issues 
U.S.  Government  Accountability  Office 
441  G  Street,  NW 
Washington,  DC  20548 

Dear  Mr.  Powner: 

Thank  you  for  the  opportunity  to  review  and  comment  on  the  Government  Accountability 
Office’s  (GAO)  draft  report  entitled  IT  WORKFORCE:  Key  Practices  Help  Ensure  Strong 
Integrated  Program  Teams;  Selected  Departments  Need  to  Assess  Skill  Gaps  (GAO- 17-08). 

On  behalf  of  the  Department  of  Commerce,  I  have  enclosed  our  comments  on  the  draft 
report.  We  concur  with  the  recommendation,  and  we  are  committed  to  addressing  the  shortfalls 
in  IT  workforce  planning  as  outlined  in  the  report. 

If  you  have  any  questions,  please  contact  Steve  Cooper,  the  Department’s  Chief 
Information  Officer,  at  (202)  482-4797. 

Sincerely, 

/5_lf4 — - 

Bruce  H.  Andrews 


Enclosure 
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Department  of  Commerce 

Comments  on  the  Government  Accountability  Office  Draft  Report  entitled 
IT  WORKFORCE:  Key  Practices  Help  Ensure  Strong  Integrated  Program  Teams;  Selected 
Departments  Need  to  Assess  Skill  Gaps  (GAO- 17-08) 

The  Office  of  the  Chief  Information  Officer  and  the  Office  of  Human  Resources  Management 
have  reviewed  the  draft  report,  and  we  offer  the  following  comments  for  the  Government 
Accountability  Office’s  (GAO)  consideration. 

General  Comments 

The  report  on  IT  Workforce  does  a  fair  and  thorough  job  in  evaluating  whether  select  Federal 
agencies  are  adequately  assessing  and  addressing  gaps  in  knowledge  and  skills  that  are  critical  to 
the  success  of  major  information  technology  acquisitions.  The  report’s  recommendations  were 
generally  well-informed,  thorough,  and  balanced. 

Comments  on  Recommendation 

GAO  made  one  recommendation  to  the  Department  of  Commerce  in  the  report. 

Recommendation: 

To  require  the  Chief  Information  Officer,  the  Chief  Human  Capital  Officer,  and  other  senior 
managers  as  appropriate  to  address  the  shortfalls  in  IT  workforce  planning  noted  in  the 
report. 

Commerce  Response:  The  Department  agrees  with  this  recommendation,  and  the 
Department  will  diligently  work  to  develop  an  action  plan  to  address  the  following: 


_ Key  Workforce  Planning  Steps  and  Activities 

Set  the  Strategic  Direction  for  IT  Workforce  Planning _ 

Analyze  the  IT  Workforce  to  Identify  Skill  Gaps 

Develop  Strategies  and  Implement  Activities  to  Address  IT  Skill  Gaps 
Monitor  and  Report  Progress  in  Addressing  IT  Skill  Gaps 
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CHIEF  INFORMATION  OFFICER 


DEPARTMENT  OF  DEFENSE 

6000  DEFENSE  PENTAGON 
WASHINGTON,  D.C.  20301-6000 


Mr.  David  A.  Powner 
Director,  Information  Technology 
U.S.  Government  Accountability  Office 
441  G  Street,  N.W. 

Washington,  DC  20548 

Dear  Mr.  Powner: 


OCT  1  8  2016 


This  is  the  Department  of  Defense  (DoD)  response  to  the  Government  Accountability 
Office  (GAO)  Draff  Report,  GAO-17-8,  “IT  WORKFORCE:  Key  Practices  Help  Ensure  Strong 
Integrated  Program  Teams;  Selected  Departments  Need  to  Assess  Skill  Gaps”  dated 
September  23,  2016  (GAO  Code  100212).  Detailed  comments  on  the  report  recommendations 
are  enclosed. 


Sincerely, 


Enclosure: 
As  stated 
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GAO  Draft  Report  Dated  September  23,  2016 
GAO-17-8  (GAO  CODE  100212) 

“IT  WORKFORCE:  KEY  PRACTICES  HELP  ENSURE  STRONG  INTEGRATED 
PROGRAM  TEAMS;  SELECTED  DEPARTMENTS  NEED  TO  ASSESS  SKILL  GAPS” 

DEPARTMENT  OF  DEFENSE  COMMENTS 
TO  THE  GAO  RECOMMENDATION 


RECOMMENDATION  1 :  The  Government  Accountability  Office  (GAO)  recommends  that 
the  Secretary  of  Defense  require  the  Chief  Information  Officer,  the  Under  Secretary  of  Defense 
for  Personnel  and  Readiness,  and  other  senior  managers  as  appropriate  to  address  the  shortfalls 
in  Information  Technology  (IT)  workforce  planning  noted  in  this  report,  including  the  following 
actions: 

•  develop  competencies  for  all  staff 

•  assess  competency  needs  regularly  for  all  positions 

•  assess  gaps  in  competencies  for  all  components  of  the  workforce 

•  develop  strategies  and  plans  to  address  gaps  in  competencies 

•  implement  activities  that  address  gaps,  including  developing  a  program  management 
career  path,  if  justified  and  cost-effective 

•  monitor  the  Department’s  progress  in  addressing  competency  gaps  identified  for  IT  staff 

•  report  to  Department  leadership  on  progress  in  addressing  competency  gaps 

DoD  RESPONSE:  DoD  partially  concurs. 

The  DoD  FY16  -  FY21  Strategic  Workforce  Plan  Report  was  recently  forwarded  to  Congress  in 
September  2016.  This  report  is  a  biennial  requirement  of  title  10,  United  States  Code,  Section 
115b.  The  September  2016  report  includes  documentation  on  the  Department’s  strategies  to 
close  competency  gaps  in  mission  critical  occupations  (MCOs)  for  the  IT  Workforce. 

As  GAO  noted  three  largest  MCOs;  0391  Telecommunications,  1550  Computer  Science,  and 
2210  IT  Management,  account  for  93%  of  the  IT  functional  community.  Competency  models 
have  been  developed  for  the  1550  and  2210  series,  and  0391  competencies  are  scheduled  to  be 
completed  by  the  end  of  1QFY17. 

The  next  largest  IT  occupation,  0335  Computer  Clerk  and  Assistant,  already  has  competencies 
developed.  This  series  accounts  for  another  2%  of  the  IT  functional  community  and  brings  the 
total  to  95%  of  the  community  with  competencies  developed,  or  developed  by  end  of  1QFY17. 

Of  the  other  1 4  IT  occupational  series  in  the  community,  half  are  populated  with  less  than  1 00 
individuals,  and  several  of  these  occupational  series  will  likely  attrite  to  a  zero  population  due  to 
skill  obsolescence. 
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For  the  purpose  of  this  GAO  study,  DoD  does  not  believe  it  is  necessary  to  develop 
competencies,  identify  competency  gaps,  and  develop  gap  closure  strategies  for  the  remaining 
5%  of  its  IT  community;  which  include  wage  grade  employees,  clerks,  and  information 
specialists  (e.g.,  librarians,  archivists),  as  these  individuals  would  likely  not  have  a  role  on 
integrated  program  teams,  or  be  in  a  position  critical  to  the  success  of  major  IT  acquisitions. 

Prioritization  of  individual  series  will  continue  to  be  evaluated  as  part  DoD’s  overall  competency 
development  program. 
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DEPARTMENT  OF  HEALTH  «  HUMAN  SERVICES 


OFFICE  OF  THE  SECRETARY 


Assistant  Secretary  for  Legislation 
Washington,  DC  20201 


NOV  0  3  2016 


David  A.  Powner 
Director,  Information  Technology 
Management  Issues 

U.S.  Government  Accountability  Office 
441  G  Street  NW 
Washington,  DC  20548 

Dear  Mr.  Powner: 

Attached  are  comments  on  the  U.S.  Government  Accountability  Office’s  (GAO)  report  entitled, 
“IT  Workforce:  Key  Practices  Help  Ensure  Strong  Integrated  Program  Teams;  Selected 
Departments  Need  to  Assess  Skill  Gaps”  (GAO-17-8). 

The  Department  appreciates  the  opportunity  to  review  this  report  prior  to  publication. 


Sincerely, 


Assistant  Secretary  for  Legislation 


Attachment 
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GENERAL  COMMENTS  OF  THE  DEPARTMENT  OF  HEALTH  AND  HUMAN 
SERVICES  (HHS1  ON  THE  GOVERNMENT  ACCOUNTABILITY  OFFICE’S  DRAFT 
REPORT  ENTITLED:  IT  WORKFORCE:  KEY  PRACTICES  HELP  ENSURE  STRONG 
INTEGRATED  PROGRAM  TEAMS:  SELECTED  DEPARTMENTS  NEED  TO  ASSESS 
SKILL  GAPS  (GAO-17-8) 

The  U.S.  Department  of  Health  and  Human  Services  (HHS)  appreciates  the  opportunity  from  the 
Government  Accountability  Office  to  review  and  comment  on  this  draft  report. 

GAO  Recommendations 

•  Establish  and  maintain  a  workforce  planning  process  inclusive  of  all  staff. 

•  Develop  staffing  requirements  for  all  positions. 

•  Assess  staffing  needs  regularly. 

•  Assess  gaps  in  competencies  and  staffing  for  all  components  of  the  workforce. 

•  Develop  strategies  and  plans  to  address  gaps  in  competencies  and  staffing. 

•  Implement  activities  that  address  gaps,  including  IT  acquisition  cadre  and  a  career  path 
for  program  managers,  if  justified  and  cost-effective. 

•  Monitor  the  department’s  progress  in  addressing  competency  and  staffing  gaps. 

•  Report  to  department  leadership  on  progress  in  addressing  competency  and  staffing  gaps. 

HHS  Comments 

HHS  concurs  with  GAO’s  recommendations.  HHS  finalized  its  IT  Program  Management  Career 
Path  on  October  5,  2016,  which  is  included  with  our  response.  This  document  was  vetted  by  the 
Department-wide  Cybersecurity  Workforce  Development  Working  Group,  Capital  Planning  and 
Investment  Control  Working  Group,  and  Federal  Information  Technology  Acquisition  Reform 
Act  Workforce  Integrated  Project  Team.  Updates  to  this  path  will  continually  be  revisited  to 
reflect  changes  in  federal  legislation  and/or  HHS  policy. 

HHS  continues  to  identify  and  improve  the  processes,  standards,  people,  and  technology  needed 
to  support  consistent,  ongoing  workforce  analyses  for  the  entire  human  capital  lifecycle. 

Through  identification  and  definition  of  critical  IT  and  cybersecurity  role  categories  and 
competency  requirements,  HHS  is  growing  the  capability  for  mature  workforce  analytics  and 
planning  on  a  consistent  and  ongoing,  enterprise- wide  basis. 

HHS  looks  forward  to  integrating  the  updated  Office  of  Personnel  Management/National 
Institute  of  Standards  and  Technology  cyber  codes,  which  will  inform  all  Federal  IT  and 
cybersecurity  workforce  analytics  and  planning  activities.  These  codes  will  be  used  for  tracking 
our  vacant  and  encumbered  IT  and  cybersecurity  positions  across  the  Department  and  assessing 
skill  gaps  and  staffing  needs. 

One  of  the  Department’s  Fiscal  Year  2017-2020,  IT  Strategic  Plan  goals  is  to  acquire,  deploy, 
and  sustain  a  technology-enabled  workforce.  This  strategy  includes  the  need  to  identify  and 
define  capability  and  capacity  needs  to  forecast  staffing;  streamline  employee  recruitment  and 
hiring;  brand  HHS  as  an  IT  and  cybersecurity  employer  of  choice;  and  develop  and  retain  our 
technology  workforce. 
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U.S.  Department  Assistant  Secretary  1 200  New  Jersey  Avenue,  SE 

Of  Transportation  for  Administration  Washington,  DC  20590 

Office  of  the  Secretary 
of  Transportation 

OCT  2  1 2016 


David  Powner 

Director,  Information  Technology  Management  Issues 
U.S.  Government  Accountability  Office 
441  G  Street  NW 
Washington,  DC  20548 

Mr.  Powner: 

The  Department  of  Transportation  (DOT)  is  committed  to  improving  its  approach  in  managing 
IT  investments  through  the  development  and  use  of  management  practices  and  training  forums 
designed  to  address  IT  skill  gaps  and  improve  workforce  planning  for  IT  Acquisition  and 
Program  Management  professionals.  The  Department  is  leveraging  its  Strategic  Workforce 
Planning  Guide  to  navigate  its  efforts  to  build  capabilities  and  innovative  methods  to  assess  IT 
skill  gaps  and  enhance  workforce  proficiency.  DOT  has  the  following  actions  underway  to 
further  improve  its  IT  workforce  planning  efforts: 

•  finalizing  plans  for  creating  IT  acquisition  cadres  and  using  direct  hiring  authority; 

•  developing  an  approach  for  cross-functional  training  of  IT  acquisition  and  program 
management  personnel;  and 

•  collaborating  across  Departmental  offices —  Chief  Information  Officer,  Human 
Resources,  and  Senior  Procurement  Executive — on  the  development  of  an  IT  manager 
career  path  for  program  managers. 

Upon  review  of  the  draft  report,  we  concur  with  the  recommendation.  The  Department  will 
provide  a  detailed  response  to  the  recommendation  within  60  days  of  the  final  report’s  issuance. 

We  appreciate  the  opportunity  to  respond  to  the  GAO  draft  report.  Please  contact  Director  of 
Audit  Relations  and  Program  Improvement  Madeline  M.  Chulumovich  at  (202)  366-6512  with 
any  questions  or  to  obtain  additional  details. 

Sincerely, 

Jeff  Marootian 

Assistant  Secretary  for  Administration 
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DEPARTMENT  OF  THE  TREASURY 

WASHINGTON,  D.C. 


October  28,  2016 


David  A.  Powner 

Director,  IT  Management  Issues 

U.S.  Government  Accountability  Office 

441  G  Street,  N.W. 

Washington,  D.C.  20548 


Dear  Mr.  Powner: 

Thank  you  for  the  opportunity  to  comment  on  the  Government  Accountability  Office’s  (GAO) 
draft  report  on  integrated  program  teams  (IPT),  IT  WORKFORCE,  Key  Practices  Help  Ensure 
Strong  Integrated  Program  Teams;  Selected  Departments  Need  to  Assess  Skill  Gaps  (GAO-17- 
8). 

The  draft  Report  identifies  one  recommendation  for  the  Department  of  the  Treasury  (Treasury). 
Specifically,  it  recommends  that  the  Chief  Information  Officer  (CIO),  the  Chief  Human  Capital 
Officer  (CHCO)  and  other  senior  managers  as  appropriate  address  the  shortfalls  in  information 
technology  (IT)  workforce  planning  noted  in  the  Report.  We  accept  the  recommendation  to 
improve  our  IT  workforce  planning. 

As  demonstrated  in  the  Report,  the  use  of  IPTs  is  a  valuable  practice  for  improving  the 
performance  of  major  IT  acquisitions.  Treasury  has  embraced  the  use  of  integrated  teams  and 
governance.  The  CIO,  CHCO  and  Senior  Procurement  Executive  have  together  championed  the 
use  of  IPTs,  providing  strong  executive  leadership  in  support  of  the  practice  generally  and  to 
specific  major  IT  programs  using  the  practice,  such  as  the  enterprise  data  management  program 
and  the  acquisition  of  an  integrated  talent  management  system  for  Treasury. 

Treasury  agrees  with  the  Report’s  observation  that  a  strong  IT  workforce  is  an  important  aspect 
of  successfully  implementing  IPTs,  and  has  made  significant  progress  to  implement  a  workforce 
planning  program  for  all  mission  critical  occupations,  including  the  IT  workforce.  In  2014,  the 
CHCO  published  Treasury  Strategic  Workforce  Planning  Policy  (HCIS  TN-14-06)  and 
established  a  framework  for  conducting  workforce  planning  assessments.  While  an  agency-wide 
assessment  of  the  IT  workforce  has  not  yet  been  completed,  several  component  bureaus  have 
been  assessing  their  workforce.  This  includes  the  Internal  Revenue  Service,  which  comprises 
over  80%  of  the  total  Treasury  IT  workforce. 

The  Federal  Information  Technology  Acquisition  Reform  Act  (FITARA)1  seeks  to  improve  the 
management  of  IT  by  empowering  Federal  executives  to  become  effective  strategic  partners  to 


1  National  Defense  Authorization  Act  of  Fiscal  Year  2015,  Div.  A,  Title  VIII,  Subtitle  D  -  Federal  Information 
Technology  Acquisition  Reform,  Pub.  L.  No.  113-291,  §  835  (Dec.  19,  2014). 
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mission  programs.  As  part  of  the  FITARA  Common  Baseline2,  the  Office  of  Management  and 
Budget  (OMB)  has  required  that  each  agency  “develop  a  set  of  competency  requirements  for  IT 
staff . . .  [and]  develop  and  maintain  a  current  workforce  planning  process”  to  anticipate  and 
respond  to  changing  requirements  and  ensure  that  the  IT  workforce  has  the  right  people  and 
skills. 

The  Department’s  FITARA  Implementation  Plan3  provides  a  plan  for  meeting  the  requirements 
established  by  Congress  and  OMB,  including  IT  workforce  management.  We  continue  to  make 
progress  towards  meeting  the  established  requirements  and  appreciate  GAO’s  recognition  of  the 
substantial  progress  that  Treasury  has  made  implementing  the  eight  workforce  planning  activities 
identified  in  the  Report.  We  are  on  track  to  establish  a  more  robust  IT  workforce  planning 
capability  by  the  end  of  the  fiscal  year  2017. 

We  appreciate  the  insights  provided  in  the  draft  Report.  If  you  have  any  questions,  please  contact 
David  Aten,  Senior  Advisor  for  Talent  Technologies,  at  (202)  927-8965. 


Sincerely, 


Sanjeev  “Sonny”  Bhagowalia 
Treasury  Chief  Information  Officer  (CIO) 


Anita  Blair 

Treasury  Chief  Human  Capital  Officer  (CHCO) 


2  OMB,  Management  and  Oversight  of  Federal  Information  Technology,  Memorandum  M-15-14  (June  10,  2015). 

3  Department  of  the  Treasury,  Federal  Information  Technology  Acquisition  Reform  Act  (FITARA)  Common  Baseline 
Implementation  Plan  (March  18,  2016). 
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GAO’s  Mission 

The  Government  Accountability  Office,  the  audit,  equation,  and  investigative 
arm  of  Congress,  exists  to  support  Congress  in  meeting  its  constitutional 
responsibilities  and  to  help  improve  the  performance  and  accountability  of  the 
federal  government  for  the  American  people.  GAO  examines  the  use  of  public 
funds;  evaluates  federal  programs  and  policies;  and  provides  analyses, 
recommendations,  and  other  assistance  to  help  Congress  make  informed 
oversight,  policy,  and  funding  decisions.  GAO’s  commitment  to  good  government 
is  reflected  in  its  core  values  of  accountability,  integrity,  and  reliability. 

Obtaining  Copies  of 
GAO  Reports  and 
Testimony 

The  fastest  and  easiest  way  to  obtain  copies  of  GAO  documents  at  no  cost  is 
through  GAO’s  website  (http://www.gao.gov).  Each  weekday  afternoon,  GAO 
posts  on  its  website  newly  released  reports,  testimony,  and  correspondence.  To 
have  GAO  e-mail  you  a  list  of  newly  posted  products,  go  to  http://www.gao.gov 
and  select  “E-mail  Updates.” 

Order  by  Phone 

The  price  of  each  GAO  publication  reflects  GAO’s  actual  cost  of  production  and 
distribution  and  depends  on  the  number  of  pages  in  the  publication  and  whether 
the  publication  is  printed  in  color  or  black  and  white.  Pricing  and  ordering 
information  is  posted  on  GAO’s  website,  http://www.gao.gov/ordering.htm. 

Place  orders  by  calling  (202)  512-6000,  toll  free  (866)  801-7077,  or 

TDD  (202)  512-2537. 

Orders  may  be  paid  for  using  American  Express,  Discover  Card,  MasterCard, 

Visa,  check,  or  money  order.  Call  for  additional  information. 

Connect  with  GAO 

Connect  with  GAO  on  Facebook,  Flickr,  Twitter,  and  YouTube. 

Subscribe  to  our  RSS  Feeds  or  E-mail  Updates.  Listen  to  our  Podcasts. 

Visit  GAO  on  the  web  at  www.gao.gov. 

To  Report  Fraud, 

Waste,  and  Abuse  in 
Federal  Programs 

Contact: 

Website:  http://www.gao.gov/fraudnet/fraudnet.htm 

E-mail:  fraudnet@gao.gov 

Automated  answering  system:  (800)  424-5454  or  (202)  512-7470 

Congressional 

Relations 

Katherine  Siggerud,  Managing  Director,  siggerudk@gao.gov,  (202)  512-4400, 

U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7125, 

Washington,  DC  20548 

Public  Affairs 

Chuck  Young,  Managing  Director,  youngd@gao.gov,  (202)  512-4800 

U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7149 

Washington,  DC  20548 

Strategic  Planning  and 
External  Liaison 

James-Christian  Blockwood,  Managing  Director,  spel@gao.gov,  (202)  512-4707 
U.S.  Government  Accountability  Office,  441  G  Street  NW,  Room  7814, 

Washington,  DC  20548 
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